2024-04-26T07:15:26.608 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T07:15:26.608 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592 --owner scheduled_teuthology@teuthology --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} --verbose -- /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/orig.config.yaml 2024-04-26T07:15:26.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T07:15:26.753 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592 branch: reef description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672592' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/octopus latest ' name: teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi no_nested_subset: false nuke-on-error: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: cephfs: max_mds: 2 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 nuke-on-error: false selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: dc093b5e41f728edab6e0330295fdf9156d31664 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 seed: 7931 sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 sleep_before_teardown: 0 subset: 126/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_dc093b5e41f728edab6e0330295fdf9156d31664/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: dc093b5e41f728edab6e0330295fdf9156d31664 targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXNea/KEGI0biH9nwfd1+ZxxINa/CFnQsnz+RQJrOkbqnWjHGRfyyCZUGsb7Mg7ou5z2kiiZYciRM15JIWV8Lg= smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFiC80bvCyu10EwKwE4LxD1tqqbzMWDQPSDNmFF2xrPhmFxfYlr8tZZQx6q7C0dShHrEWQaTZX0549YxF1ZBs/0= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCf/hw3lSaVa92J9J6B40z+bYQvWjga5QfSO0I9xle6q5/6fhdKZnd/MhDfl/Nx0tOb++poz+DAMAHemjQ+hAIY= tasks: - install: branch: octopus exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing octopus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client octopus - print: '**** done ceph' - ceph-fuse: null - print: '**** done octopus client' - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: quincy - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph osd require-osd-release quincy - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - install.upgrade: client.0: branch: quincy - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: mounted: false client.1: skip: true - ceph-fuse: client.0: null client.1: skip: true - print: '**** done remount client' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs required_client_features cephfs add metric_collect - sleep: duration: 5 - fs.clients_evicted: clients: client.0: false client.1: true - workunit: clients: client.0: - suites/fsstress.sh - print: '**** done fsstress' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_22:24:15 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T07:15:26.754 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_dc093b5e41f728edab6e0330295fdf9156d31664/qa; will attempt to use it 2024-04-26T07:15:26.754 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_dc093b5e41f728edab6e0330295fdf9156d31664/qa/tasks 2024-04-26T07:15:26.755 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T07:15:26.756 INFO:teuthology.task.internal:Checking packages... 2024-04-26T07:15:26.781 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '19b26365dac54ee709df8c5dc2a7b7e89a50aba5' 2024-04-26T07:15:26.781 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:15:26.781 INFO:teuthology.packaging:ref: None 2024-04-26T07:15:26.781 INFO:teuthology.packaging:tag: None 2024-04-26T07:15:26.781 INFO:teuthology.packaging:branch: reef 2024-04-26T07:15:26.781 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:15:26.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-26T07:15:27.093 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T07:15:27.094 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T07:15:27.100 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T07:15:27.100 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T07:15:27.189 INFO:teuthology.task.internal:Saving configuration 2024-04-26T07:15:27.208 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T07:15:27.216 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T07:15:27.242 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 07:10:18.161680', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXNea/KEGI0biH9nwfd1+ZxxINa/CFnQsnz+RQJrOkbqnWjHGRfyyCZUGsb7Mg7ou5z2kiiZYciRM15JIWV8Lg='} 2024-04-26T07:15:27.267 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 07:10:18.165788', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFiC80bvCyu10EwKwE4LxD1tqqbzMWDQPSDNmFF2xrPhmFxfYlr8tZZQx6q7C0dShHrEWQaTZX0549YxF1ZBs/0='} 2024-04-26T07:15:27.289 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 07:10:18.164032', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCf/hw3lSaVa92J9J6B40z+bYQvWjga5QfSO0I9xle6q5/6fhdKZnd/MhDfl/Nx0tOb++poz+DAMAHemjQ+hAIY='} 2024-04-26T07:15:27.290 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T07:15:27.297 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-26T07:15:27.297 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['client.0'] 2024-04-26T07:15:27.298 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['client.1'] 2024-04-26T07:15:27.298 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T07:15:27.420 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff97492d160>, signals=[15]) 2024-04-26T07:15:27.420 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T07:15:27.426 INFO:teuthology.task.internal:Opening connections... 2024-04-26T07:15:27.426 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:15:27.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:15:27.508 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-04-26T07:15:27.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:15:27.581 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T07:15:27.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:15:27.655 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T07:15:27.662 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-04-26T07:15:27.685 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-04-26T07:15:27.686 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-04-26T07:15:27.747 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T07:15:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T07:15:27.749 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-04-26T07:15:27.773 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-26T07:15:27.796 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-26T07:15:27.796 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T07:15:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T07:15:27.858 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-26T07:15:27.898 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-26T07:15:27.919 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-26T07:15:27.920 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T07:15:27.982 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-26T07:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T07:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T07:15:27.983 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T07:15:27.983 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-26T07:15:28.006 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T07:15:28.016 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T07:15:28.050 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T07:15:28.051 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-04-26T07:15:28.053 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-04-26T07:15:28.055 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-04-26T07:15:28.076 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T07:15:28.084 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T07:15:28.084 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-04-26T07:15:28.116 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-04-26T07:15:28.118 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-04-26T07:15:28.150 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T07:15:28.221 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T07:15:28.237 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T07:15:28.237 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}, 'client.1': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T07:15:28.237 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T07:15:28.238 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T07:15:28.238 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T07:15:28.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:15:28.259 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-26T07:15:28.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:15:28.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:15:28.261 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-04-26T07:15:28.261 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-26T07:15:28.322 INFO:teuthology.orchestra.run.smithi057.stdout:4.18.0-489.el8.x86_64 2024-04-26T07:15:28.322 INFO:teuthology.task.kernel:Running kernel on smithi057: 4.18.0-489.el8.x86_64 2024-04-26T07:15:28.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum install -y kernel 2024-04-26T07:15:28.324 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-489.el8.x86_64 2024-04-26T07:15:28.324 INFO:teuthology.orchestra.run.smithi172.stdout:4.18.0-489.el8.x86_64 2024-04-26T07:15:28.324 INFO:teuthology.task.kernel:Running kernel on smithi031: 4.18.0-489.el8.x86_64 2024-04-26T07:15:28.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2024-04-26T07:15:28.324 INFO:teuthology.task.kernel:Running kernel on smithi172: 4.18.0-489.el8.x86_64 2024-04-26T07:15:28.325 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-04-26T07:15:32.556 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - AppStream 17 MB/s | 28 MB 00:01 2024-04-26T07:15:32.730 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - AppStream 14 MB/s | 28 MB 00:01 2024-04-26T07:15:32.820 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - AppStream 15 MB/s | 28 MB 00:01 2024-04-26T07:15:38.106 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 10 MB 00:00 2024-04-26T07:15:38.530 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 10 MB 00:00 2024-04-26T07:15:38.821 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 10 MB 00:00 2024-04-26T07:15:39.956 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - Extras 75 kB/s | 18 kB 00:00 2024-04-26T07:15:40.332 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - Extras common packages 29 kB/s | 7.7 kB 00:00 2024-04-26T07:15:40.497 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras 86 kB/s | 18 kB 00:00 2024-04-26T07:15:40.625 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2024-04-26T07:15:40.756 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras common packages 53 kB/s | 7.7 kB 00:00 2024-04-26T07:15:40.887 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2024-04-26T07:15:41.007 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-26T07:15:41.155 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras common packages 51 kB/s | 7.7 kB 00:00 2024-04-26T07:15:41.407 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-26T07:15:41.928 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-26T07:15:42.075 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2024-04-26T07:15:42.309 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2024-04-26T07:15:45.684 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 410 kB/s | 24 kB 00:00 2024-04-26T07:15:46.108 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 437 kB/s | 24 kB 00:00 2024-04-26T07:15:46.415 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 610 kB/s | 24 kB 00:00 2024-04-26T07:15:48.756 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T07:15:48.756 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T07:15:48.878 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T07:15:48.879 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:15:48.880 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:15:48.880 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:15:48.880 INFO:teuthology.orchestra.run.smithi172.stdout:Install 3 Packages 2024-04-26T07:15:48.880 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:15:48.880 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 90 M 2024-04-26T07:15:48.880 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 96 M 2024-04-26T07:15:48.880 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:15:49.388 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T07:15:49.388 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T07:15:49.524 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:15:49.525 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:15:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-26T07:15:49.525 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout:Install 3 Packages 2024-04-26T07:15:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:15:49.527 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 90 M 2024-04-26T07:15:49.527 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 96 M 2024-04-26T07:15:49.527 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:15:49.604 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T07:15:49.604 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T07:15:49.660 INFO:teuthology.orchestra.run.smithi172.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 17 MB/s | 10 MB 00:00 2024-04-26T07:15:49.723 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:15:49.724 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:15:49.724 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout:Install 3 Packages 2024-04-26T07:15:49.725 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:15:49.726 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 90 M 2024-04-26T07:15:49.726 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 96 M 2024-04-26T07:15:49.726 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:15:51.069 INFO:teuthology.orchestra.run.smithi172.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 18 MB/s | 36 MB 00:02 2024-04-26T07:15:52.275 INFO:teuthology.orchestra.run.smithi031.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 4.1 MB/s | 10 MB 00:02 2024-04-26T07:15:53.544 INFO:teuthology.orchestra.run.smithi172.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 9.8 MB/s | 44 MB 00:04 2024-04-26T07:15:53.544 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:15:53.545 INFO:teuthology.orchestra.run.smithi172.stdout:Total 19 MB/s | 90 MB 00:04 2024-04-26T07:15:54.230 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:15:54.458 INFO:teuthology.orchestra.run.smithi057.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 2.2 MB/s | 10 MB 00:04 2024-04-26T07:15:54.689 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:15:54.689 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:15:55.925 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:15:55.954 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:15:58.753 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:15:59.295 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:01.257 INFO:teuthology.orchestra.run.smithi057.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 3.2 MB/s | 36 MB 00:11 2024-04-26T07:16:01.349 INFO:teuthology.orchestra.run.smithi031.stdout:(2/3): kernel-core-4.18.0-552.el8.x86_64.rpm 3.8 MB/s | 44 MB 00:11 2024-04-26T07:16:01.683 INFO:teuthology.orchestra.run.smithi031.stdout:(3/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 3.0 MB/s | 36 MB 00:11 2024-04-26T07:16:01.683 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:16:01.683 INFO:teuthology.orchestra.run.smithi031.stdout:Total 7.4 MB/s | 90 MB 00:12 2024-04-26T07:16:02.190 INFO:teuthology.orchestra.run.smithi057.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 3.5 MB/s | 44 MB 00:12 2024-04-26T07:16:02.191 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:16:02.191 INFO:teuthology.orchestra.run.smithi057.stdout:Total 7.3 MB/s | 90 MB 00:12 2024-04-26T07:16:02.403 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:16:02.851 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:02.855 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:16:02.855 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:16:02.903 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:16:03.253 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:03.356 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:16:03.356 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:16:04.161 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:16:04.176 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:16:04.690 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:16:04.718 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:16:06.717 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:07.036 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:07.159 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:16:07.672 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:16:08.305 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:11.429 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:11.814 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:12.087 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:12.488 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:15.497 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:16.170 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:16.483 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:29.093 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:29.118 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:29.559 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:29.560 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:29.560 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:30.019 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:30.019 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:16:30.019 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:16:30.019 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T07:16:30.019 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T07:16:30.019 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:16:30.019 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:16:30.173 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T07:16:30.387 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T07:16:30.387 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T07:16:30.387 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T07:16:30.387 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T07:16:30.388 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T07:16:30.388 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-26T07:16:30.388 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T07:16:30.388 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T07:16:30.599 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T07:16:30.600 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T07:16:30.600 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-04-26T07:16:30.633 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-04-26T07:16:30.633 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-04-26T07:16:30.633 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.02 2024-04-26T07:16:30.633 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 129.el8 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Group : System Environment/Base 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 9265586 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Relocations : (not relocatable) 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : CentOS BuildSystem 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-04-26T07:16:30.634 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-04-26T07:16:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:16:30.635 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T07:16:30.635 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T07:16:30.635 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T07:16:30.635 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-04-26T07:16:30.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:16:30.635 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T07:16:30.636 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T07:16:30.636 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 4.18.0-552.el8.x86_64 2024-04-26T07:16:30.636 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T07:16:32.063 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-04-26T07:16:34.368 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-04-26T07:16:34.369 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-04-26T07:16:34.391 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.AgljfhEvsh 2024-04-26T07:16:34.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AgljfhEvsh 2024-04-26T07:16:34.464 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.AgljfhEvsh 2024-04-26T07:16:34.608 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.AgljfhEvsh is 6KB 2024-04-26T07:16:34.656 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.AgljfhEvsh 2024-04-26T07:16:34.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T07:16:34.747 INFO:teuthology.orchestra.run.smithi172.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T07:16:34.747 INFO:teuthology.orchestra.run.smithi172.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T07:16:34.747 INFO:teuthology.orchestra.run.smithi172.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T07:16:34.747 INFO:teuthology.orchestra.run.smithi172.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T07:16:34.749 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T07:16:34.913 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-04-26T07:16:39.129 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:39.154 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:39.517 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:39.517 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:39.517 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:40.056 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:40.056 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:16:40.056 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:16:40.056 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T07:16:40.056 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T07:16:40.056 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:16:40.056 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:16:40.126 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:40.151 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:40.192 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T07:16:40.418 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T07:16:40.418 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T07:16:40.418 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T07:16:40.418 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T07:16:40.419 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T07:16:40.419 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T07:16:40.419 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T07:16:40.419 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T07:16:40.517 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:40.517 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T07:16:40.518 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T07:16:40.639 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T07:16:40.639 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T07:16:40.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.02 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 129.el8 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Group : System Environment/Base 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 9265586 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T07:16:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:Relocations : (not relocatable) 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : CentOS BuildSystem 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : CentOS 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:16:40.675 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T07:16:40.676 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T07:16:40.676 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 4.18.0-552.el8.x86_64 2024-04-26T07:16:40.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T07:16:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T07:16:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:16:41.036 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:16:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T07:16:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T07:16:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:16:41.036 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:16:41.243 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T07:16:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T07:16:41.475 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T07:16:41.475 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T07:16:41.475 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T07:16:41.475 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T07:16:41.475 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-26T07:16:41.475 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T07:16:41.475 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T07:16:41.696 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T07:16:41.696 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T07:16:41.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -qi grub2-tools 2024-04-26T07:16:41.731 INFO:teuthology.orchestra.run.smithi057.stdout:Name : grub2-tools 2024-04-26T07:16:41.731 INFO:teuthology.orchestra.run.smithi057.stdout:Epoch : 1 2024-04-26T07:16:41.731 INFO:teuthology.orchestra.run.smithi057.stdout:Version : 2.02 2024-04-26T07:16:41.731 INFO:teuthology.orchestra.run.smithi057.stdout:Release : 129.el8 2024-04-26T07:16:41.731 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: x86_64 2024-04-26T07:16:41.731 INFO:teuthology.orchestra.run.smithi057.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Group : System Environment/Base 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Size : 9265586 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:License : GPLv3+ 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Relocations : (not relocatable) 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Packager : CentOS BuildSystem 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Vendor : CentOS 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Summary : Support tools for GRUB. 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:Description : 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:16:41.732 INFO:teuthology.orchestra.run.smithi057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T07:16:41.733 INFO:teuthology.orchestra.run.smithi057.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T07:16:41.733 INFO:teuthology.orchestra.run.smithi057.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T07:16:41.733 INFO:teuthology.orchestra.run.smithi057.stdout:hardware devices. 2024-04-26T07:16:41.733 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:16:41.733 INFO:teuthology.orchestra.run.smithi057.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T07:16:41.734 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T07:16:41.734 INFO:teuthology.task.kernel:Updating grub on smithi057 to boot 4.18.0-552.el8.x86_64 2024-04-26T07:16:41.734 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T07:16:41.971 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-04-26T07:16:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2024-04-26T07:16:44.358 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-04-26T07:16:44.360 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-26T07:16:44.387 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.SrKoUIbGPR 2024-04-26T07:16:44.387 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SrKoUIbGPR 2024-04-26T07:16:44.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.SrKoUIbGPR 2024-04-26T07:16:44.610 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.SrKoUIbGPR is 6KB 2024-04-26T07:16:44.659 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.SrKoUIbGPR 2024-04-26T07:16:44.677 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T07:16:44.743 INFO:teuthology.orchestra.run.smithi031.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T07:16:44.743 INFO:teuthology.orchestra.run.smithi031.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T07:16:44.743 INFO:teuthology.orchestra.run.smithi031.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T07:16:44.744 INFO:teuthology.orchestra.run.smithi031.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T07:16:44.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T07:16:44.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-04-26T07:16:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:done 2024-04-26T07:16:45.016 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-26T07:16:45.042 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.XEJZPXVLsb 2024-04-26T07:16:45.042 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XEJZPXVLsb 2024-04-26T07:16:45.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.XEJZPXVLsb 2024-04-26T07:16:45.267 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.XEJZPXVLsb is 6KB 2024-04-26T07:16:45.316 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.XEJZPXVLsb 2024-04-26T07:16:45.334 DEBUG:teuthology.orchestra.run.smithi057:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T07:16:45.408 INFO:teuthology.orchestra.run.smithi057.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T07:16:45.408 INFO:teuthology.orchestra.run.smithi057.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T07:16:45.408 INFO:teuthology.orchestra.run.smithi057.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T07:16:45.408 INFO:teuthology.orchestra.run.smithi057.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T07:16:45.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T07:16:45.556 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2024-04-26T07:17:04.934 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-26T07:17:04.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T07:17:04.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:17:14.924 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T07:17:14.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-26T07:17:14.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:17:15.560 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-26T07:17:15.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-26T07:17:15.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:17:23.363 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-26T07:17:32.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T07:17:32.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:17:33.342 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-26T07:17:34.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-26T07:17:35.427 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-26T07:17:42.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-26T07:17:42.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:17:43.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-26T07:17:43.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:17:46.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-26T07:17:47.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T07:17:47.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:17:58.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-26T07:17:58.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:18:00.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-26T07:18:05.858 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-26T07:18:12.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-26T07:18:12.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:18:13.048 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-04-26T07:18:13.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-26T07:18:13.558 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-26T07:18:13.558 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-04-26T07:18:13.577 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-552.el8.x86_64 2024-04-26T07:18:13.577 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T07:18:13.578 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T07:18:13.578 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T07:18:14.578 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T07:18:14.579 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T07:18:14.670 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2024-04-26T07:18:14.683 DEBUG:teuthology.parallel:result is None 2024-04-26T07:18:20.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T07:18:20.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:18:21.242 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-26T07:18:21.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T07:18:21.550 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-552.el8.x86_64"... 2024-04-26T07:18:21.550 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-26T07:18:21.567 INFO:teuthology.orchestra.run.smithi172.stdout:4.18.0-552.el8.x86_64 2024-04-26T07:18:21.567 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T07:18:21.567 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T07:18:21.567 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T07:18:22.568 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2024-04-26T07:18:22.568 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-04-26T07:18:22.657 DEBUG:teuthology.parallel:result is None 2024-04-26T07:18:58.189 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T07:19:13.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-26T07:19:13.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:19:13.546 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-26T07:19:13.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-26T07:19:13.855 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-552.el8.x86_64"... 2024-04-26T07:19:13.855 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-26T07:19:13.876 INFO:teuthology.orchestra.run.smithi057.stdout:4.18.0-552.el8.x86_64 2024-04-26T07:19:13.876 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T07:19:13.876 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T07:19:13.876 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T07:19:14.877 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-04-26T07:19:14.877 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T07:19:14.975 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-04-26T07:19:14.995 DEBUG:teuthology.parallel:result is None 2024-04-26T07:19:14.996 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T07:19:15.003 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T07:19:15.003 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T07:19:15.007 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T07:19:15.010 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T07:19:15.034 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T07:19:15.042 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T07:19:15.071 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T07:19:15.072 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T07:19:15.074 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T07:19:15.076 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T07:19:15.126 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T07:19:15.134 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T07:19:15.134 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T07:19:15.139 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T07:19:15.142 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T07:19:15.176 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:19:15.182 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:19:15.183 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:19:15.188 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:19:15.197 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:19:15.197 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:19:15.197 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T07:19:15.204 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T07:19:15.204 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T07:19:15.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T07:19:15.235 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T07:19:15.266 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T07:19:15.275 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T07:19:15.275 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T07:19:15.304 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T07:19:15.309 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T07:19:15.328 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:19:15.411 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:19:15.463 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:19:15.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:19:15.594 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:19:15.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T07:19:15.662 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:19:15.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:19:15.773 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:19:15.821 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:19:15.867 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:19:15.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T07:19:15.937 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:19:15.986 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:19:16.040 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:19:16.128 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:19:16.171 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:19:16.172 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T07:19:16.240 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-04-26T07:19:16.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-04-26T07:19:16.245 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-04-26T07:19:16.317 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:19:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:19:16.346 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:19:16.653 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T07:19:16.661 INFO:teuthology.task.internal:Starting timer... 2024-04-26T07:19:16.661 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T07:19:16.697 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T07:19:16.725 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-26T07:19:16.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2024-04-26T07:19:16.810 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2024-04-26T07:19:16.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-04-26T07:19:16.907 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-04-26T07:19:16.909 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-04-26T07:19:17.004 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-04-26T07:19:17.006 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T07:19:17.006 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2024-04-26T07:19:17.052 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2024-04-26T07:19:17.052 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-04-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-04-26T07:19:17.115 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-04-26T07:19:17.151 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-04-26T07:19:17.151 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-04-26T07:19:17.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T07:19:17.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:19:17.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T07:19:17.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:19:17.212 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T07:19:17.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:19:17.241 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T07:19:17.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2024-04-26T07:19:17.272 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-04-26T07:19:17.302 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-04-26T07:19:17.329 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T07:19:17.339 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T07:19:17.345 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T07:19:17.477 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T07:19:17.492 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T07:19:17.494 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi057.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T07:25:25.486 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-04-26T07:25:25.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-26T07:25:25.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:25:25.570 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-04-26T07:25:25.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-26T07:25:25.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-26T07:25:25.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:25:25.716 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-26T07:25:25.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-26T07:25:25.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T07:25:25.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:25:25.871 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-26T07:25:25.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-26T07:25:25.942 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T07:25:25.953 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T07:25:25.953 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T07:25:25.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:25:25.956 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T07:25:25.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:25:25.959 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T07:25:25.959 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:25:25.992 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T07:25:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T07:25:26.008 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T07:25:26.011 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T07:25:26.015 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T07:25:26.030 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T07:25:26.082 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-04-26T07:25:26.087 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2024-04-26T07:25:26.094 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-04-26T07:25:26.097 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-04-26T07:25:26.100 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2024-04-26T07:25:26.109 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-04-26T07:25:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T07:25:26.115 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T07:25:26.123 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T07:25:26.123 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T07:25:26.130 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T07:25:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T07:25:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2024-04-26T07:25:26.196 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:25:26.196 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-04-26T07:25:26.197 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.197 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.197 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.197 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.201 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2024-04-26T07:25:26.204 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2024-04-26T07:25:26.206 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:25:26.206 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-04-26T07:25:26.206 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.206 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.207 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.207 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-26T07:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.208 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:25:26.209 INFO:teuthology.run_tasks:Running task install... 2024-04-26T07:25:26.217 DEBUG:teuthology.task.install:project ceph 2024-04-26T07:25:26.218 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5'}} 2024-04-26T07:25:26.218 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5'} 2024-04-26T07:25:26.218 INFO:teuthology.task.install:Using flavor: default 2024-04-26T07:25:26.225 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T07:25:26.225 INFO:teuthology.task.install:extra packages: ['librados2'] 2024-04-26T07:25:26.226 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5', 'tag': None, 'wait_for_package': False} 2024-04-26T07:25:26.226 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:25:26.226 INFO:teuthology.packaging:ref: None 2024-04-26T07:25:26.226 INFO:teuthology.packaging:tag: None 2024-04-26T07:25:26.226 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:25:26.226 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:25:26.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-26T07:25:26.228 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5', 'tag': None, 'wait_for_package': False} 2024-04-26T07:25:26.229 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:25:26.229 INFO:teuthology.packaging:ref: None 2024-04-26T07:25:26.229 INFO:teuthology.packaging:tag: None 2024-04-26T07:25:26.229 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:25:26.229 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:25:26.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-26T07:25:26.230 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5', 'tag': None, 'wait_for_package': False} 2024-04-26T07:25:26.230 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:25:26.230 INFO:teuthology.packaging:ref: None 2024-04-26T07:25:26.230 INFO:teuthology.packaging:tag: None 2024-04-26T07:25:26.230 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:25:26.230 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:25:26.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-26T07:25:26.448 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-26T07:25:26.449 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-26T07:25:26.469 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-26T07:25:26.469 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-26T07:25:26.493 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T07:25:26.493 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:25:26.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T07:25:26.507 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T07:25:26.507 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:25:26.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T07:25:26.524 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-26T07:25:26.524 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:25:26.524 INFO:teuthology.packaging:ref: None 2024-04-26T07:25:26.524 INFO:teuthology.packaging:tag: None 2024-04-26T07:25:26.524 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:25:26.524 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:25:26.524 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T07:25:26.536 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-26T07:25:26.536 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:25:26.536 INFO:teuthology.packaging:ref: None 2024-04-26T07:25:26.536 INFO:teuthology.packaging:tag: None 2024-04-26T07:25:26.537 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:25:26.537 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:25:26.537 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T07:25:26.551 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-26T07:25:26.552 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-26T07:25:26.579 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T07:25:26.579 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:25:26.579 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T07:25:26.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T07:25:26.605 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T07:25:26.612 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-26T07:25:26.612 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:25:26.613 INFO:teuthology.packaging:ref: None 2024-04-26T07:25:26.613 INFO:teuthology.packaging:tag: None 2024-04-26T07:25:26.613 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:25:26.613 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:25:26.613 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T07:25:26.676 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T07:25:26.682 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T07:25:26.685 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T07:25:26.745 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-04-26T07:25:26.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-04-26T07:25:26.748 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-04-26T07:25:26.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-04-26T07:25:26.768 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T07:25:26.838 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-04-26T07:25:26.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-04-26T07:25:27.016 INFO:teuthology.orchestra.run.smithi172.stdout:78 files removed 2024-04-26T07:25:27.031 INFO:teuthology.orchestra.run.smithi057.stdout:78 files removed 2024-04-26T07:25:27.044 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw 2024-04-26T07:25:27.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw 2024-04-26T07:25:27.122 INFO:teuthology.orchestra.run.smithi031.stdout:78 files removed 2024-04-26T07:25:27.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw 2024-04-26T07:25:27.523 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 903 kB/s | 68 kB 00:00 2024-04-26T07:25:27.567 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 830 kB/s | 68 kB 00:00 2024-04-26T07:25:27.615 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 273 kB/s | 15 kB 00:00 2024-04-26T07:25:27.666 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 777 kB/s | 68 kB 00:00 2024-04-26T07:25:27.685 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 192 kB/s | 15 kB 00:00 2024-04-26T07:25:27.716 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-04-26T07:25:27.794 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 22 kB/s | 1.7 kB 00:00 2024-04-26T07:25:27.808 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 146 kB/s | 15 kB 00:00 2024-04-26T07:25:27.917 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 22 kB/s | 1.7 kB 00:00 2024-04-26T07:25:29.608 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - AppStream 15 MB/s | 28 MB 00:01 2024-04-26T07:25:29.953 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - AppStream 13 MB/s | 28 MB 00:02 2024-04-26T07:25:31.659 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - AppStream 7.5 MB/s | 28 MB 00:03 2024-04-26T07:25:35.325 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 10 MB 00:00 2024-04-26T07:25:35.936 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-04-26T07:25:37.175 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - Extras 71 kB/s | 18 kB 00:00 2024-04-26T07:25:37.643 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 10 MB 00:00 2024-04-26T07:25:37.759 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 7.7 kB 00:00 2024-04-26T07:25:38.004 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2024-04-26T07:25:38.636 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 8 - PowerTools 6.3 MB/s | 5.0 MB 00:00 2024-04-26T07:25:38.688 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 7.7 kB 00:00 2024-04-26T07:25:39.389 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - PowerTools 8.3 MB/s | 5.0 MB 00:00 2024-04-26T07:25:39.635 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras 78 kB/s | 18 kB 00:00 2024-04-26T07:25:39.704 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-04-26T07:25:40.327 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.7 kB 00:00 2024-04-26T07:25:40.513 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2024-04-26T07:25:40.616 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2024-04-26T07:25:41.228 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - PowerTools 6.2 MB/s | 5.0 MB 00:00 2024-04-26T07:25:42.011 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-26T07:25:42.371 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-26T07:25:44.200 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 16 MB 00:01 2024-04-26T07:25:44.322 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 400 kB/s | 24 kB 00:00 2024-04-26T07:25:46.310 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 77 kB/s | 24 kB 00:00 2024-04-26T07:25:48.019 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-26T07:25:48.022 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T07:25:48.023 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout:Install 22 Packages 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 2 Packages 2024-04-26T07:25:48.024 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:25:48.025 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 49 M 2024-04-26T07:25:48.025 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:25:48.365 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 379 kB/s | 24 kB 00:00 2024-04-26T07:25:48.598 INFO:teuthology.orchestra.run.smithi172.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 31 MB/s | 5.6 MB 00:00 2024-04-26T07:25:48.623 INFO:teuthology.orchestra.run.smithi172.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-26T07:25:48.657 INFO:teuthology.orchestra.run.smithi172.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-04-26T07:25:48.690 INFO:teuthology.orchestra.run.smithi172.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 11 MB/s | 380 kB 00:00 2024-04-26T07:25:48.782 INFO:teuthology.orchestra.run.smithi172.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 35 MB/s | 3.2 MB 00:00 2024-04-26T07:25:48.808 INFO:teuthology.orchestra.run.smithi172.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-04-26T07:25:48.833 INFO:teuthology.orchestra.run.smithi172.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 3.0 MB/s | 77 kB 00:00 2024-04-26T07:25:48.858 INFO:teuthology.orchestra.run.smithi172.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.5 MB/s | 164 kB 00:00 2024-04-26T07:25:48.967 INFO:teuthology.orchestra.run.smithi172.stdout:(9/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 18 MB/s | 9.9 MB 00:00 2024-04-26T07:25:48.992 INFO:teuthology.orchestra.run.smithi172.stdout:(10/24): python3-rados-15.2.17-0.el8.x86_64.rpm 2.7 MB/s | 364 kB 00:00 2024-04-26T07:25:49.017 INFO:teuthology.orchestra.run.smithi172.stdout:(11/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 4.4 MB/s | 113 kB 00:00 2024-04-26T07:25:49.043 INFO:teuthology.orchestra.run.smithi172.stdout:(12/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 4.5 MB/s | 349 kB 00:00 2024-04-26T07:25:49.293 INFO:teuthology.orchestra.run.smithi172.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 24 MB/s | 21 MB 00:00 2024-04-26T07:25:49.593 INFO:teuthology.orchestra.run.smithi172.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 146 kB/s | 44 kB 00:00 2024-04-26T07:25:49.652 INFO:teuthology.orchestra.run.smithi172.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 426 kB/s | 259 kB 00:00 2024-04-26T07:25:49.677 INFO:teuthology.orchestra.run.smithi172.stdout:(16/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 563 kB/s | 47 kB 00:00 2024-04-26T07:25:49.753 INFO:teuthology.orchestra.run.smithi172.stdout:(17/24): librdkafka-1.6.1-1.el8.x86_64.rpm 921 kB/s | 677 kB 00:00 2024-04-26T07:25:49.840 INFO:teuthology.orchestra.run.smithi172.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 621 kB/s | 116 kB 00:00 2024-04-26T07:25:49.886 INFO:teuthology.orchestra.run.smithi172.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 1.3 MB/s | 181 kB 00:00 2024-04-26T07:25:49.912 INFO:teuthology.orchestra.run.smithi172.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2024-04-26T07:25:49.937 INFO:teuthology.orchestra.run.smithi172.stdout:(21/24): liboath-2.6.2-3.el8.x86_64.rpm 606 kB/s | 59 kB 00:00 2024-04-26T07:25:49.962 INFO:teuthology.orchestra.run.smithi172.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 997 kB/s | 75 kB 00:00 2024-04-26T07:25:50.013 INFO:teuthology.orchestra.run.smithi172.stdout:(23/24): librbd1-15.2.17-0.el8.x86_64.rpm 26 MB/s | 1.9 MB 00:00 2024-04-26T07:25:50.071 INFO:teuthology.orchestra.run.smithi172.stdout:(24/24): librados2-15.2.17-0.el8.x86_64.rpm 22 MB/s | 3.5 MB 00:00 2024-04-26T07:25:50.073 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:25:50.073 INFO:teuthology.orchestra.run.smithi172.stdout:Total 24 MB/s | 49 MB 00:02 2024-04-26T07:25:50.118 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:25:50.164 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:25:50.164 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:25:50.261 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:25:50.263 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:25:50.263 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-26T07:25:50.263 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-26T07:25:50.264 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:25:50.265 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:25:50.266 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:25:50.266 INFO:teuthology.orchestra.run.smithi057.stdout:Install 22 Packages 2024-04-26T07:25:50.266 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 2 Packages 2024-04-26T07:25:50.266 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:25:50.266 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 49 M 2024-04-26T07:25:50.266 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:25:50.497 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:25:50.500 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:25:50.686 INFO:teuthology.orchestra.run.smithi057.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 34 MB/s | 5.6 MB 00:00 2024-04-26T07:25:50.703 INFO:teuthology.orchestra.run.smithi057.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2024-04-26T07:25:50.745 INFO:teuthology.orchestra.run.smithi057.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 12 MB/s | 508 kB 00:00 2024-04-26T07:25:50.778 INFO:teuthology.orchestra.run.smithi057.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 11 MB/s | 380 kB 00:00 2024-04-26T07:25:50.879 INFO:teuthology.orchestra.run.smithi057.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 32 MB/s | 3.2 MB 00:00 2024-04-26T07:25:50.904 INFO:teuthology.orchestra.run.smithi057.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-04-26T07:25:50.963 INFO:teuthology.orchestra.run.smithi057.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 1.3 MB/s | 77 kB 00:00 2024-04-26T07:25:50.988 INFO:teuthology.orchestra.run.smithi057.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.4 MB/s | 164 kB 00:00 2024-04-26T07:25:51.013 INFO:teuthology.orchestra.run.smithi057.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 14 MB/s | 364 kB 00:00 2024-04-26T07:25:51.047 INFO:teuthology.orchestra.run.smithi057.stdout:(10/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 10 MB/s | 349 kB 00:00 2024-04-26T07:25:51.072 INFO:teuthology.orchestra.run.smithi057.stdout:(11/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 4.5 MB/s | 113 kB 00:00 2024-04-26T07:25:51.181 INFO:teuthology.orchestra.run.smithi057.stdout:(12/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 15 MB/s | 9.9 MB 00:00 2024-04-26T07:25:51.415 INFO:teuthology.orchestra.run.smithi057.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-04-26T07:25:51.516 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:25:51.624 INFO:teuthology.orchestra.run.smithi057.stdout:(14/24): librdkafka-1.6.1-1.el8.x86_64.rpm 1.2 MB/s | 677 kB 00:00 2024-04-26T07:25:51.690 INFO:teuthology.orchestra.run.smithi057.stdout:(15/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-04-26T07:25:51.716 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-26T07:25:51.769 INFO:teuthology.orchestra.run.smithi057.stdout:(16/24): python3-prettytable-0.7.2-14.el8.noarc 124 kB/s | 44 kB 00:00 2024-04-26T07:25:51.800 INFO:teuthology.orchestra.run.smithi057.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 1.0 MB/s | 116 kB 00:00 2024-04-26T07:25:51.825 INFO:teuthology.orchestra.run.smithi057.stdout:(18/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 403 kB/s | 259 kB 00:00 2024-04-26T07:25:51.858 INFO:teuthology.orchestra.run.smithi057.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 3.0 MB/s | 181 kB 00:00 2024-04-26T07:25:51.884 INFO:teuthology.orchestra.run.smithi057.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 2.6 MB/s | 306 kB 00:00 2024-04-26T07:25:51.909 INFO:teuthology.orchestra.run.smithi057.stdout:(21/24): liboath-2.6.2-3.el8.x86_64.rpm 702 kB/s | 59 kB 00:00 2024-04-26T07:25:51.934 INFO:teuthology.orchestra.run.smithi057.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 995 kB/s | 75 kB 00:00 2024-04-26T07:25:51.953 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-26T07:25:51.985 INFO:teuthology.orchestra.run.smithi057.stdout:(23/24): librbd1-15.2.17-0.el8.x86_64.rpm 26 MB/s | 1.9 MB 00:00 2024-04-26T07:25:52.068 INFO:teuthology.orchestra.run.smithi057.stdout:(24/24): librados2-15.2.17-0.el8.x86_64.rpm 19 MB/s | 3.5 MB 00:00 2024-04-26T07:25:52.070 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:25:52.071 INFO:teuthology.orchestra.run.smithi057.stdout:Total 27 MB/s | 49 MB 00:01 2024-04-26T07:25:52.112 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-26T07:25:52.116 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:25:52.167 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:25:52.167 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:25:52.318 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:25:52.321 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:25:52.321 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-04-26T07:25:52.321 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:25:52.321 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:25:52.321 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-26T07:25:52.322 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-04-26T07:25:52.322 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-26T07:25:52.322 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-26T07:25:52.322 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-26T07:25:52.322 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-26T07:25:52.323 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-26T07:25:52.323 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-26T07:25:52.323 INFO:teuthology.orchestra.run.smithi031.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-26T07:25:52.323 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T07:25:52.323 INFO:teuthology.orchestra.run.smithi031.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-26T07:25:52.323 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-26T07:25:52.324 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T07:25:52.324 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T07:25:52.324 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-26T07:25:52.324 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T07:25:52.324 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-26T07:25:52.324 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T07:25:52.325 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T07:25:52.325 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-26T07:25:52.325 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-26T07:25:52.325 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-26T07:25:52.325 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T07:25:52.325 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-26T07:25:52.326 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-26T07:25:52.326 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-26T07:25:52.326 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:25:52.326 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:25:52.326 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:25:52.326 INFO:teuthology.orchestra.run.smithi031.stdout:Install 22 Packages 2024-04-26T07:25:52.327 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 2 Packages 2024-04-26T07:25:52.327 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:25:52.327 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 49 M 2024-04-26T07:25:52.328 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:25:52.481 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-26T07:25:52.495 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:25:52.498 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:25:52.645 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:25:52.736 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:25:52.944 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-26T07:25:53.058 INFO:teuthology.orchestra.run.smithi031.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 34 MB/s | 5.6 MB 00:00 2024-04-26T07:25:53.074 INFO:teuthology.orchestra.run.smithi031.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2024-04-26T07:25:53.108 INFO:teuthology.orchestra.run.smithi031.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-04-26T07:25:53.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:25:53.141 INFO:teuthology.orchestra.run.smithi031.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 11 MB/s | 380 kB 00:00 2024-04-26T07:25:53.225 INFO:teuthology.orchestra.run.smithi031.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 39 MB/s | 3.2 MB 00:00 2024-04-26T07:25:53.250 INFO:teuthology.orchestra.run.smithi031.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-04-26T07:25:53.309 INFO:teuthology.orchestra.run.smithi031.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 1.3 MB/s | 77 kB 00:00 2024-04-26T07:25:53.334 INFO:teuthology.orchestra.run.smithi031.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.4 MB/s | 164 kB 00:00 2024-04-26T07:25:53.341 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:25:53.368 INFO:teuthology.orchestra.run.smithi031.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 11 MB/s | 364 kB 00:00 2024-04-26T07:25:53.402 INFO:teuthology.orchestra.run.smithi031.stdout:(10/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 10 MB/s | 349 kB 00:00 2024-04-26T07:25:53.427 INFO:teuthology.orchestra.run.smithi031.stdout:(11/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 4.5 MB/s | 113 kB 00:00 2024-04-26T07:25:53.536 INFO:teuthology.orchestra.run.smithi031.stdout:(12/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 15 MB/s | 9.9 MB 00:00 2024-04-26T07:25:53.553 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:25:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:25:53.618 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:25:53.786 INFO:teuthology.orchestra.run.smithi031.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-04-26T07:25:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-26T07:25:53.863 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-26T07:25:54.020 INFO:teuthology.orchestra.run.smithi031.stdout:(14/24): librdkafka-1.6.1-1.el8.x86_64.rpm 1.1 MB/s | 677 kB 00:00 2024-04-26T07:25:54.065 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-26T07:25:54.078 INFO:teuthology.orchestra.run.smithi031.stdout:(15/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-04-26T07:25:54.095 INFO:teuthology.orchestra.run.smithi031.stdout:(16/24): python3-prettytable-0.7.2-14.el8.noarc 142 kB/s | 44 kB 00:00 2024-04-26T07:25:54.196 INFO:teuthology.orchestra.run.smithi031.stdout:(17/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 394 kB/s | 259 kB 00:00 2024-04-26T07:25:54.210 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-26T07:25:54.319 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-26T07:25:54.495 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:25:54.562 INFO:teuthology.orchestra.run.smithi031.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 240 kB/s | 116 kB 00:00 2024-04-26T07:25:54.575 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:25:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-26T07:25:54.688 INFO:teuthology.orchestra.run.smithi031.stdout:(19/24): gperftools-libs-2.7-9.el8.x86_64.rpm 517 kB/s | 306 kB 00:00 2024-04-26T07:25:54.713 INFO:teuthology.orchestra.run.smithi031.stdout:(20/24): leveldb-1.22-1.el8.x86_64.rpm 350 kB/s | 181 kB 00:00 2024-04-26T07:25:54.758 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-26T07:25:54.814 INFO:teuthology.orchestra.run.smithi031.stdout:(21/24): librados2-15.2.17-0.el8.x86_64.rpm 35 MB/s | 3.5 MB 00:00 2024-04-26T07:25:54.838 INFO:teuthology.orchestra.run.smithi031.stdout:(22/24): liboath-2.6.2-3.el8.x86_64.rpm 213 kB/s | 59 kB 00:00 2024-04-26T07:25:54.843 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:25:54.864 INFO:teuthology.orchestra.run.smithi031.stdout:(23/24): libunwind-1.3.1-3.el8.x86_64.rpm 427 kB/s | 75 kB 00:00 2024-04-26T07:25:54.905 INFO:teuthology.orchestra.run.smithi031.stdout:(24/24): librbd1-15.2.17-0.el8.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2024-04-26T07:25:54.907 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:25:54.907 INFO:teuthology.orchestra.run.smithi031.stdout:Total 19 MB/s | 49 MB 00:02 2024-04-26T07:25:54.920 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-26T07:25:54.944 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:25:54.954 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:25:55.004 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:25:55.004 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:25:55.115 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-26T07:25:55.219 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-26T07:25:55.302 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-26T07:25:55.327 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:25:55.331 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:25:55.410 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:25:55.485 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-26T07:25:55.642 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:25:55.661 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-26T07:25:55.720 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-26T07:25:55.843 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:25:55.896 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:25:55.920 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-26T07:25:56.103 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-26T07:25:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-26T07:25:56.286 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-26T07:25:56.407 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:25:56.487 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-26T07:25:56.627 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-26T07:25:56.632 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-26T07:25:56.801 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:25:56.829 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-26T07:25:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:25:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-26T07:25:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-26T07:25:57.220 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-26T07:25:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-26T07:25:57.417 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-26T07:25:57.587 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-26T07:25:57.600 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:25:57.698 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:25:57.778 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-26T07:25:57.951 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-26T07:25:57.951 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-26T07:25:58.022 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-26T07:25:58.133 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:25:58.354 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:25:58.381 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-26T07:25:58.558 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:25:58.603 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-26T07:25:58.645 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:25:58.659 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:25:58.799 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-26T07:25:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-26T07:25:58.886 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:25:58.960 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-26T07:25:59.336 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-26T07:25:59.508 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:25:59.546 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:25:59.585 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:25:59.739 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-26T07:25:59.805 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-26T07:25:59.910 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-26T07:25:59.916 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-26T07:26:00.036 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-26T07:26:00.293 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-26T07:26:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-26T07:26:00.682 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-26T07:26:00.757 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-26T07:26:00.963 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-26T07:26:01.176 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-26T07:26:01.318 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:26:01.373 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-26T07:26:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:26:01.583 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-26T07:26:02.232 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:26:02.501 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-26T07:26:02.653 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-26T07:26:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:03.896 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:26:04.107 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:26:04.810 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-26T07:26:05.076 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-26T07:26:05.191 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-26T07:26:05.324 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /run 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2024-04-26T07:26:18.824 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:19.843 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-26T07:26:19.916 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-26T07:26:19.916 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-26T07:26:20.109 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-26T07:26:20.110 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:20.810 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:20.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-26T07:26:20.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-26T07:26:20.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-26T07:26:20.810 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-26T07:26:20.811 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-26T07:26:20.812 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-26T07:26:21.746 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:21.746 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:21.746 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-04-26T07:26:21.746 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: leveldb-1.22-1.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.747 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:21.748 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:26:22.045 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-test 2024-04-26T07:26:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:22.450 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /run 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2024-04-26T07:26:22.451 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:22.775 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:38 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:26:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-26T07:26:23.635 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-26T07:26:23.635 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-26T07:26:23.874 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-26T07:26:23.875 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:24.440 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:26:24.441 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:24.441 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T07:26:24.441 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:24.441 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout:Install 5 Packages 2024-04-26T07:26:24.442 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:24.443 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 43 M 2024-04-26T07:26:24.443 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 155 M 2024-04-26T07:26:24.443 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-26T07:26:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-26T07:26:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-26T07:26:24.880 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:24.880 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2024-04-26T07:26:24.880 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2024-04-26T07:26:24.880 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2024-04-26T07:26:24.880 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /run 2024-04-26T07:26:24.880 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2024-04-26T07:26:24.880 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2024-04-26T07:26:24.880 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2024-04-26T07:26:24.881 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2024-04-26T07:26:24.881 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2024-04-26T07:26:24.881 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:25.165 INFO:teuthology.orchestra.run.smithi172.stdout:(1/5): ceph-test-15.2.17-0.el8.x86_64.rpm 78 MB/s | 42 MB 00:00 2024-04-26T07:26:25.190 INFO:teuthology.orchestra.run.smithi172.stdout:(2/5): oniguruma-6.8.2-3.el8.x86_64.rpm 335 kB/s | 188 kB 00:00 2024-04-26T07:26:25.215 INFO:teuthology.orchestra.run.smithi172.stdout:(3/5): jq-1.6-8.el8.x86_64.rpm 346 kB/s | 203 kB 00:00 2024-04-26T07:26:25.310 INFO:teuthology.orchestra.run.smithi172.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 590 kB/s | 71 kB 00:00 2024-04-26T07:26:25.534 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:25.534 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:25.534 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-04-26T07:26:25.534 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.534 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:26:25.534 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.534 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.534 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: leveldb-1.22-1.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.535 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.536 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T07:26:25.536 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.536 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.536 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:25.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:25.536 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:26:25.624 INFO:teuthology.orchestra.run.smithi172.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 705 kB/s | 323 kB 00:00 2024-04-26T07:26:25.624 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:26:25.625 INFO:teuthology.orchestra.run.smithi172.stdout:Total 36 MB/s | 43 MB 00:01 2024-04-26T07:26:25.668 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:26:25.687 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:26:25.687 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:26:25.897 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-test 2024-04-26T07:26:25.972 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-26T07:26:25.974 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:26:25.977 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:26:26.051 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-26T07:26:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-26T07:26:26.280 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-26T07:26:26.281 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:26.410 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:26:26.643 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-26T07:26:26.655 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:41 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:26:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-26T07:26:26.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:26.987 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:26.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-26T07:26:26.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-26T07:26:26.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-26T07:26:26.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-26T07:26:26.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-26T07:26:26.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-26T07:26:26.987 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-26T07:26:26.988 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-26T07:26:26.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-26T07:26:26.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-26T07:26:26.989 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-26T07:26:27.003 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:27.913 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T07:26:27.914 INFO:teuthology.orchestra.run.smithi031.stdout: leveldb-1.22-1.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:27.916 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:27.916 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:26:28.257 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-test 2024-04-26T07:26:28.439 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:26:28.439 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout:Install 5 Packages 2024-04-26T07:26:28.440 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:28.441 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 43 M 2024-04-26T07:26:28.441 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 155 M 2024-04-26T07:26:28.441 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:26:29.018 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:41 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:26:29.284 INFO:teuthology.orchestra.run.smithi057.stdout:(1/5): ceph-test-15.2.17-0.el8.x86_64.rpm 67 MB/s | 42 MB 00:00 2024-04-26T07:26:29.309 INFO:teuthology.orchestra.run.smithi057.stdout:(2/5): oniguruma-6.8.2-3.el8.x86_64.rpm 290 kB/s | 188 kB 00:00 2024-04-26T07:26:29.334 INFO:teuthology.orchestra.run.smithi057.stdout:(3/5): jq-1.6-8.el8.x86_64.rpm 301 kB/s | 203 kB 00:00 2024-04-26T07:26:29.409 INFO:teuthology.orchestra.run.smithi057.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 705 kB/s | 71 kB 00:00 2024-04-26T07:26:29.734 INFO:teuthology.orchestra.run.smithi057.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 717 kB/s | 323 kB 00:00 2024-04-26T07:26:29.735 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:26:29.736 INFO:teuthology.orchestra.run.smithi057.stdout:Total 33 MB/s | 43 MB 00:01 2024-04-26T07:26:29.779 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:26:29.800 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:26:29.800 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:26:30.085 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:26:30.088 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:26:30.514 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:26:30.756 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-26T07:26:30.800 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T07:26:30.801 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:30.802 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:26:30.802 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:26:30.802 INFO:teuthology.orchestra.run.smithi031.stdout:Install 5 Packages 2024-04-26T07:26:30.802 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:30.802 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 43 M 2024-04-26T07:26:30.802 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 155 M 2024-04-26T07:26:30.802 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:26:30.804 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-26T07:26:30.958 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-26T07:26:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:31.079 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-26T07:26:31.173 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:31.362 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-26T07:26:31.362 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-26T07:26:31.362 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-26T07:26:31.362 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:31.362 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-26T07:26:31.589 INFO:teuthology.orchestra.run.smithi031.stdout:(1/5): ceph-test-15.2.17-0.el8.x86_64.rpm 70 MB/s | 42 MB 00:00 2024-04-26T07:26:31.618 INFO:teuthology.orchestra.run.smithi031.stdout:(2/5): oniguruma-6.8.2-3.el8.x86_64.rpm 298 kB/s | 188 kB 00:00 2024-04-26T07:26:31.643 INFO:teuthology.orchestra.run.smithi031.stdout:(3/5): jq-1.6-8.el8.x86_64.rpm 310 kB/s | 203 kB 00:00 2024-04-26T07:26:31.710 INFO:teuthology.orchestra.run.smithi031.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 768 kB/s | 71 kB 00:00 2024-04-26T07:26:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-26T07:26:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:31.826 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:26:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-26T07:26:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-26T07:26:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T07:26:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:31.826 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:26:32.027 INFO:teuthology.orchestra.run.smithi031.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 737 kB/s | 323 kB 00:00 2024-04-26T07:26:32.028 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:26:32.028 INFO:teuthology.orchestra.run.smithi031.stdout:Total 35 MB/s | 43 MB 00:01 2024-04-26T07:26:32.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph 2024-04-26T07:26:32.071 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:26:32.092 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:26:32.092 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:26:32.380 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:26:32.383 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:26:32.843 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:26:32.844 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:48 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:26:33.035 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-26T07:26:33.223 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-26T07:26:33.369 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:33.449 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:34.495 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:26:34.498 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:34.498 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-26T07:26:34.498 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:34.498 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:26:34.498 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-26T07:26:34.498 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T07:26:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T07:26:34.500 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T07:26:34.501 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T07:26:34.501 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T07:26:34.501 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:34.501 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:26:34.501 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:34.501 INFO:teuthology.orchestra.run.smithi172.stdout:Install 32 Packages 2024-04-26T07:26:34.501 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:34.502 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 28 M 2024-04-26T07:26:34.502 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 91 M 2024-04-26T07:26:34.502 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:26:35.157 INFO:teuthology.orchestra.run.smithi172.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 130 kB/s | 6.3 kB 00:00 2024-04-26T07:26:35.207 INFO:teuthology.orchestra.run.smithi172.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-04-26T07:26:35.231 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-26T07:26:35.249 INFO:teuthology.orchestra.run.smithi172.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-04-26T07:26:35.274 INFO:teuthology.orchestra.run.smithi172.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 7.6 MB/s | 193 kB 00:00 2024-04-26T07:26:35.357 INFO:teuthology.orchestra.run.smithi172.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 22 MB/s | 4.3 MB 00:00 2024-04-26T07:26:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-26T07:26:35.600 INFO:teuthology.orchestra.run.smithi172.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 43 MB/s | 17 MB 00:00 2024-04-26T07:26:35.650 INFO:teuthology.orchestra.run.smithi172.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 418 kB/s | 157 kB 00:00 2024-04-26T07:26:35.755 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-26T07:26:35.755 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-26T07:26:35.755 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-26T07:26:35.755 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:35.755 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-26T07:26:35.758 INFO:teuthology.orchestra.run.smithi172.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 526 kB/s | 57 kB 00:00 2024-04-26T07:26:35.784 INFO:teuthology.orchestra.run.smithi172.stdout:(9/32): python3-markupsafe-0.23-19.el8.x86_64.r 91 kB/s | 39 kB 00:00 2024-04-26T07:26:35.868 INFO:teuthology.orchestra.run.smithi172.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2024-04-26T07:26:35.935 INFO:teuthology.orchestra.run.smithi172.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.5 MB/s | 457 kB 00:00 2024-04-26T07:26:35.985 INFO:teuthology.orchestra.run.smithi172.stdout:(12/32): python3-cryptography-3.2.1-7.el8.x86_6 5.4 MB/s | 641 kB 00:00 2024-04-26T07:26:36.010 INFO:teuthology.orchestra.run.smithi172.stdout:(13/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 252 kB/s | 103 kB 00:00 2024-04-26T07:26:36.035 INFO:teuthology.orchestra.run.smithi172.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 1.1 MB/s | 109 kB 00:00 2024-04-26T07:26:36.192 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-26T07:26:36.193 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:36.193 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:26:36.193 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-26T07:26:36.193 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-26T07:26:36.193 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T07:26:36.193 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:36.193 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:26:36.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph 2024-04-26T07:26:36.544 INFO:teuthology.orchestra.run.smithi172.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 78 kB/s | 44 kB 00:00 2024-04-26T07:26:36.736 INFO:teuthology.orchestra.run.smithi172.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 255 kB/s | 185 kB 00:00 2024-04-26T07:26:36.786 INFO:teuthology.orchestra.run.smithi172.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 230 kB/s | 173 kB 00:00 2024-04-26T07:26:36.853 INFO:teuthology.orchestra.run.smithi172.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2024-04-26T07:26:36.912 INFO:teuthology.orchestra.run.smithi172.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 140 kB/s | 18 kB 00:00 2024-04-26T07:26:37.112 INFO:teuthology.orchestra.run.smithi172.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 188 kB/s | 49 kB 00:00 2024-04-26T07:26:37.162 INFO:teuthology.orchestra.run.smithi172.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 234 kB/s | 59 kB 00:00 2024-04-26T07:26:37.183 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:52 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:26:37.296 INFO:teuthology.orchestra.run.smithi172.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 117 kB/s | 16 kB 00:00 2024-04-26T07:26:37.438 INFO:teuthology.orchestra.run.smithi172.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 132 kB/s | 19 kB 00:00 2024-04-26T07:26:37.509 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-26T07:26:37.580 INFO:teuthology.orchestra.run.smithi172.stdout:(24/32): python3-singledispatch-3.4.0.3-18.el8. 169 kB/s | 24 kB 00:00 2024-04-26T07:26:37.680 INFO:teuthology.orchestra.run.smithi172.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 498 kB/s | 283 kB 00:00 2024-04-26T07:26:37.722 INFO:teuthology.orchestra.run.smithi172.stdout:(26/32): python3-cherrypy-18.4.0-1.el8.noarch.r 327 kB/s | 384 kB 00:01 2024-04-26T07:26:37.747 INFO:teuthology.orchestra.run.smithi172.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 175 kB/s | 29 kB 00:00 2024-04-26T07:26:37.806 INFO:teuthology.orchestra.run.smithi172.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 219 kB/s | 27 kB 00:00 2024-04-26T07:26:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-26T07:26:37.998 INFO:teuthology.orchestra.run.smithi172.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 445 kB/s | 85 kB 00:00 2024-04-26T07:26:38.090 INFO:teuthology.orchestra.run.smithi172.stdout:(30/32): python3-waitress-1.4.3-1.el8.noarch.rp 695 kB/s | 255 kB 00:00 2024-04-26T07:26:38.115 INFO:teuthology.orchestra.run.smithi172.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 197 kB/s | 23 kB 00:00 2024-04-26T07:26:38.158 INFO:teuthology.orchestra.run.smithi172.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 612 kB/s | 251 kB 00:00 2024-04-26T07:26:38.162 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:26:38.162 INFO:teuthology.orchestra.run.smithi172.stdout:Total 7.8 MB/s | 28 MB 00:03 2024-04-26T07:26:38.170 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-26T07:26:38.170 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-26T07:26:38.170 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-26T07:26:38.170 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-26T07:26:38.170 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-26T07:26:38.244 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:26:38.282 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:26:38.282 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:26:38.595 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:26:38.598 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:26:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-26T07:26:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:38.611 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:26:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-26T07:26:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-26T07:26:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T07:26:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:38.611 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:26:38.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph 2024-04-26T07:26:38.978 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:26:38.982 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:26:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-26T07:26:38.982 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:26:38.982 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:26:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-26T07:26:38.983 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-26T07:26:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-26T07:26:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-26T07:26:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-26T07:26:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-26T07:26:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-26T07:26:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T07:26:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T07:26:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T07:26:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T07:26:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T07:26:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T07:26:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T07:26:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T07:26:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T07:26:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T07:26:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T07:26:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T07:26:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T07:26:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T07:26:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T07:26:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T07:26:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T07:26:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T07:26:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T07:26:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T07:26:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout:Install 32 Packages 2024-04-26T07:26:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:38.988 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 28 M 2024-04-26T07:26:38.988 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 91 M 2024-04-26T07:26:38.988 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:26:39.309 INFO:teuthology.orchestra.run.smithi057.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 98 kB/s | 6.3 kB 00:00 2024-04-26T07:26:39.369 INFO:teuthology.orchestra.run.smithi057.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-04-26T07:26:39.489 INFO:teuthology.orchestra.run.smithi057.stdout:(3/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 24 MB/s | 4.3 MB 00:00 2024-04-26T07:26:39.535 INFO:teuthology.orchestra.run.smithi057.stdout:(4/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 7.0 MB/s | 2.0 MB 00:00 2024-04-26T07:26:39.561 INFO:teuthology.orchestra.run.smithi057.stdout:(5/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 2.7 MB/s | 193 kB 00:00 2024-04-26T07:26:39.631 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:51 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:26:39.728 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:26:39.803 INFO:teuthology.orchestra.run.smithi057.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 39 MB/s | 17 MB 00:00 2024-04-26T07:26:39.927 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-26T07:26:39.978 INFO:teuthology.orchestra.run.smithi057.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 93 kB/s | 39 kB 00:00 2024-04-26T07:26:40.145 INFO:teuthology.orchestra.run.smithi057.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 258 kB/s | 157 kB 00:00 2024-04-26T07:26:40.162 INFO:teuthology.orchestra.run.smithi057.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 310 kB/s | 57 kB 00:00 2024-04-26T07:26:40.170 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-26T07:26:40.187 INFO:teuthology.orchestra.run.smithi057.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 270 kB/s | 103 kB 00:00 2024-04-26T07:26:40.279 INFO:teuthology.orchestra.run.smithi057.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2024-04-26T07:26:40.354 INFO:teuthology.orchestra.run.smithi057.stdout:(12/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.1 MB/s | 457 kB 00:00 2024-04-26T07:26:40.380 INFO:teuthology.orchestra.run.smithi057.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.1 MB/s | 109 kB 00:00 2024-04-26T07:26:40.380 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-26T07:26:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 2.9 MB/s | 641 kB 00:00 2024-04-26T07:26:40.633 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-26T07:26:40.814 INFO:teuthology.orchestra.run.smithi057.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 95 kB/s | 44 kB 00:00 2024-04-26T07:26:40.833 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-26T07:26:40.972 INFO:teuthology.orchestra.run.smithi057.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 313 kB/s | 185 kB 00:00 2024-04-26T07:26:40.997 INFO:teuthology.orchestra.run.smithi057.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 291 kB/s | 173 kB 00:00 2024-04-26T07:26:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-26T07:26:41.098 INFO:teuthology.orchestra.run.smithi057.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2024-04-26T07:26:41.146 INFO:teuthology.orchestra.run.smithi057.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 118 kB/s | 18 kB 00:00 2024-04-26T07:26:41.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-26T07:26:41.223 INFO:teuthology.orchestra.run.smithi057.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 940 kB/s | 384 kB 00:00 2024-04-26T07:26:41.248 INFO:teuthology.orchestra.run.smithi057.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 324 kB/s | 49 kB 00:00 2024-04-26T07:26:41.282 INFO:teuthology.orchestra.run.smithi057.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 433 kB/s | 59 kB 00:00 2024-04-26T07:26:41.334 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-26T07:26:41.366 INFO:teuthology.orchestra.run.smithi057.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2024-04-26T07:26:41.391 INFO:teuthology.orchestra.run.smithi057.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2024-04-26T07:26:41.414 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:26:41.418 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:26:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-04-26T07:26:41.418 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:26:41.418 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:26:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-26T07:26:41.418 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-26T07:26:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T07:26:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T07:26:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T07:26:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T07:26:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:41.421 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:26:41.421 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:26:41.421 INFO:teuthology.orchestra.run.smithi031.stdout:Install 32 Packages 2024-04-26T07:26:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:41.421 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 28 M 2024-04-26T07:26:41.422 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 91 M 2024-04-26T07:26:41.422 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:26:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 118 kB/s | 19 kB 00:00 2024-04-26T07:26:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 204 kB/s | 24 kB 00:00 2024-04-26T07:26:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 250 kB/s | 29 kB 00:00 2024-04-26T07:26:41.559 INFO:teuthology.orchestra.run.smithi057.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 235 kB/s | 27 kB 00:00 2024-04-26T07:26:41.584 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-26T07:26:41.668 INFO:teuthology.orchestra.run.smithi057.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.5 MB/s | 251 kB 00:00 2024-04-26T07:26:41.719 INFO:teuthology.orchestra.run.smithi057.stdout:(30/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.1 MB/s | 255 kB 00:00 2024-04-26T07:26:41.743 INFO:teuthology.orchestra.run.smithi057.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 464 kB/s | 85 kB 00:00 2024-04-26T07:26:41.777 INFO:teuthology.orchestra.run.smithi057.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 211 kB/s | 23 kB 00:00 2024-04-26T07:26:41.781 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:26:41.781 INFO:teuthology.orchestra.run.smithi057.stdout:Total 10 MB/s | 28 MB 00:02 2024-04-26T07:26:41.837 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-26T07:26:41.866 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:26:41.907 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:26:41.907 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:26:42.108 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-26T07:26:42.177 INFO:teuthology.orchestra.run.smithi031.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 119 kB/s | 6.3 kB 00:00 2024-04-26T07:26:42.211 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:26:42.214 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:26:42.251 INFO:teuthology.orchestra.run.smithi031.stdout:(2/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 16 MB/s | 2.0 MB 00:00 2024-04-26T07:26:42.294 INFO:teuthology.orchestra.run.smithi031.stdout:(3/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 8.4 MB/s | 1.4 MB 00:00 2024-04-26T07:26:42.319 INFO:teuthology.orchestra.run.smithi031.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 7.6 MB/s | 193 kB 00:00 2024-04-26T07:26:42.348 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-26T07:26:42.420 INFO:teuthology.orchestra.run.smithi031.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 18 MB/s | 4.3 MB 00:00 2024-04-26T07:26:42.662 INFO:teuthology.orchestra.run.smithi031.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 41 MB/s | 17 MB 00:00 2024-04-26T07:26:42.721 INFO:teuthology.orchestra.run.smithi031.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 392 kB/s | 157 kB 00:00 2024-04-26T07:26:42.726 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-26T07:26:42.813 INFO:teuthology.orchestra.run.smithi031.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 623 kB/s | 57 kB 00:00 2024-04-26T07:26:42.868 INFO:teuthology.orchestra.run.smithi031.stdout:(9/32): python3-markupsafe-0.23-19.el8.x86_64.r 87 kB/s | 39 kB 00:00 2024-04-26T07:26:42.947 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-26T07:26:42.963 INFO:teuthology.orchestra.run.smithi031.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.6 MB/s | 249 kB 00:00 2024-04-26T07:26:42.989 INFO:teuthology.orchestra.run.smithi031.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.5 MB/s | 457 kB 00:00 2024-04-26T07:26:43.039 INFO:teuthology.orchestra.run.smithi031.stdout:(12/32): python3-cryptography-3.2.1-7.el8.x86_6 8.3 MB/s | 641 kB 00:00 2024-04-26T07:26:43.064 INFO:teuthology.orchestra.run.smithi031.stdout:(13/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 258 kB/s | 103 kB 00:00 2024-04-26T07:26:43.089 INFO:teuthology.orchestra.run.smithi031.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 1.1 MB/s | 109 kB 00:00 2024-04-26T07:26:43.152 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-26T07:26:43.181 INFO:teuthology.orchestra.run.smithi031.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 306 kB/s | 44 kB 00:00 2024-04-26T07:26:43.223 INFO:teuthology.orchestra.run.smithi031.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.3 MB/s | 173 kB 00:00 2024-04-26T07:26:43.249 INFO:teuthology.orchestra.run.smithi031.stdout:(17/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.0 MB/s | 185 kB 00:00 2024-04-26T07:26:43.274 INFO:teuthology.orchestra.run.smithi031.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2024-04-26T07:26:43.299 INFO:teuthology.orchestra.run.smithi031.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 350 kB/s | 18 kB 00:00 2024-04-26T07:26:43.324 INFO:teuthology.orchestra.run.smithi031.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 971 kB/s | 49 kB 00:00 2024-04-26T07:26:43.400 INFO:teuthology.orchestra.run.smithi031.stdout:(21/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.7 MB/s | 384 kB 00:00 2024-04-26T07:26:43.403 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-26T07:26:43.448 INFO:teuthology.orchestra.run.smithi031.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 397 kB/s | 59 kB 00:00 2024-04-26T07:26:43.475 INFO:teuthology.orchestra.run.smithi031.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2024-04-26T07:26:43.501 INFO:teuthology.orchestra.run.smithi031.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 356 kB/s | 19 kB 00:00 2024-04-26T07:26:43.526 INFO:teuthology.orchestra.run.smithi031.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 478 kB/s | 24 kB 00:00 2024-04-26T07:26:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:26:43.551 INFO:teuthology.orchestra.run.smithi031.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2024-04-26T07:26:43.568 INFO:teuthology.orchestra.run.smithi031.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 436 kB/s | 29 kB 00:00 2024-04-26T07:26:43.585 INFO:teuthology.orchestra.run.smithi031.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 467 kB/s | 27 kB 00:00 2024-04-26T07:26:43.587 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-26T07:26:43.627 INFO:teuthology.orchestra.run.smithi031.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2024-04-26T07:26:43.652 INFO:teuthology.orchestra.run.smithi031.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.2 MB/s | 85 kB 00:00 2024-04-26T07:26:43.669 INFO:teuthology.orchestra.run.smithi031.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 550 kB/s | 23 kB 00:00 2024-04-26T07:26:43.694 INFO:teuthology.orchestra.run.smithi031.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.0 MB/s | 251 kB 00:00 2024-04-26T07:26:43.696 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:26:43.696 INFO:teuthology.orchestra.run.smithi031.stdout:Total 12 MB/s | 28 MB 00:02 2024-04-26T07:26:43.745 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-26T07:26:43.781 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:26:43.822 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:26:43.822 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:26:43.879 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-26T07:26:44.103 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-26T07:26:44.109 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-26T07:26:44.150 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:26:44.153 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:26:44.289 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-26T07:26:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-26T07:26:44.458 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-26T07:26:44.603 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-26T07:26:44.719 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-26T07:26:44.799 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-26T07:26:44.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-26T07:26:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-26T07:26:45.139 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-26T07:26:45.140 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-26T07:26:45.283 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-26T07:26:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:26:45.465 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-26T07:26:45.528 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-26T07:26:45.582 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-26T07:26:45.747 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-26T07:26:45.784 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-26T07:26:45.798 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-26T07:26:46.021 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-26T07:26:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-26T07:26:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-26T07:26:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-26T07:26:46.288 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-26T07:26:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-26T07:26:46.538 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-26T07:26:46.631 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-26T07:26:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-26T07:26:46.890 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-26T07:26:46.937 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-26T07:26:47.098 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-26T07:26:47.132 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-26T07:26:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-26T07:26:47.377 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-26T07:26:47.638 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-26T07:26:47.653 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-26T07:26:47.656 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-26T07:26:47.859 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-26T07:26:47.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-26T07:26:47.991 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-26T07:26:48.126 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-26T07:26:48.249 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-26T07:26:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-26T07:26:48.436 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-26T07:26:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-26T07:26:48.527 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-26T07:26:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-26T07:26:48.619 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-26T07:26:48.754 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-26T07:26:48.769 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-26T07:26:48.787 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-26T07:26:48.869 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-26T07:26:48.894 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-26T07:26:48.990 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-26T07:26:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-26T07:26:49.245 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-26T07:26:49.302 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-26T07:26:49.302 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-26T07:26:49.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-26T07:26:49.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-26T07:26:49.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-26T07:26:49.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-26T07:26:49.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-26T07:26:49.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-26T07:26:49.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-26T07:26:49.343 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-26T07:26:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-26T07:26:49.703 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-26T07:26:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-26T07:26:49.998 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-26T07:26:50.004 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-26T07:26:50.153 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-26T07:26:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-26T07:26:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:50.189 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:26:50.189 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-26T07:26:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T07:26:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T07:26:50.191 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T07:26:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T07:26:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T07:26:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T07:26:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T07:26:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T07:26:50.192 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T07:26:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T07:26:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T07:26:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T07:26:50.193 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T07:26:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T07:26:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T07:26:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T07:26:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T07:26:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T07:26:50.194 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T07:26:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T07:26:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T07:26:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T07:26:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T07:26:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T07:26:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T07:26:50.195 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T07:26:50.196 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:50.196 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:26:50.357 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-26T07:26:50.488 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-base 2024-04-26T07:26:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-26T07:26:50.601 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-26T07:26:50.652 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-26T07:26:50.815 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-26T07:26:51.051 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-26T07:26:51.231 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:07 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:26:51.406 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-26T07:26:51.731 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-26T07:26:52.100 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-26T07:26:52.112 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-26T07:26:52.252 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-26T07:26:52.285 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-26T07:26:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-26T07:26:52.810 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-26T07:26:52.842 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:26:52.889 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:26:52.890 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:26:52.890 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:26:53.002 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T07:26:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-26T07:26:53.152 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-26T07:26:53.170 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-26T07:26:53.285 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-26T07:26:53.709 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-26T07:26:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-26T07:26:53.711 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-26T07:26:53.712 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-26T07:26:53.712 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-26T07:26:53.712 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-26T07:26:53.712 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-26T07:26:53.712 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-26T07:26:53.713 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-26T07:26:53.713 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-26T07:26:53.713 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-26T07:26:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:09 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:26:53.732 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-26T07:26:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-26T07:26:54.347 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-26T07:26:54.541 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-26T07:26:54.734 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-26T07:26:54.743 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-26T07:26:54.743 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:54.743 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:26:54.743 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:54.743 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:54.743 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T07:26:54.744 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T07:26:54.745 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:26:54.746 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:26:54.915 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-26T07:26:54.934 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-26T07:26:55.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-base 2024-04-26T07:26:55.099 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-26T07:26:55.364 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:26:55.365 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-26T07:26:55.366 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:55.366 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 203 k 2024-04-26T07:26:55.366 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 599 k 2024-04-26T07:26:55.366 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:26:55.458 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 2.2 MB/s | 203 kB 00:00 2024-04-26T07:26:55.459 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:26:55.459 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.1 MB/s | 203 kB 00:00 2024-04-26T07:26:55.459 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:26:55.469 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:26:55.470 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:26:55.518 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:26:55.522 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-26T07:26:55.523 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-26T07:26:55.524 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-26T07:26:55.525 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-26T07:26:55.525 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-26T07:26:55.525 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:26:55.636 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:26:55.784 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:26:55.838 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:10 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:26:56.190 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:26:56.427 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-26T07:26:56.427 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:56.427 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:26:56.427 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:56.427 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:56.427 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T07:26:56.428 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:26:56.429 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:26:56.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:26:56.570 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:56.570 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:26:56.570 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-26T07:26:56.570 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:26:56.570 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:26:56.699 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-base 2024-04-26T07:26:56.835 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr 2024-04-26T07:26:57.458 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:09 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:26:57.547 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:26:57.572 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:13 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:26:57.600 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:26:57.601 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:26:57.601 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:26:57.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T07:26:58.485 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:13 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:26:59.171 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:26:59.189 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:26:59.224 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:26:59.225 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:26:59.225 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:26:59.238 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:26:59.239 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:26:59.239 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:26:59.325 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T07:26:59.639 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-fuse 2024-04-26T07:27:00.080 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:12 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:00.255 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:00.256 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:00.256 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-04-26T07:27:00.256 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:00.256 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:27:00.256 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-26T07:27:00.256 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:00.257 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:27:00.257 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:00.257 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-26T07:27:00.257 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:00.257 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 203 k 2024-04-26T07:27:00.257 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 599 k 2024-04-26T07:27:00.257 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:27:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 3.0 MB/s | 203 kB 00:00 2024-04-26T07:27:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:Total 3.0 MB/s | 203 kB 00:00 2024-04-26T07:27:00.324 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:27:00.335 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:27:00.335 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:27:00.365 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:16 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:00.387 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:27:00.390 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:27:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:27:00.692 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:01.126 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:01.518 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:27:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:01.518 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:01.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr 2024-04-26T07:27:01.852 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:01.852 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-26T07:27:01.853 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:01.854 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 203 k 2024-04-26T07:27:01.854 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 599 k 2024-04-26T07:27:01.854 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:27:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 4.4 MB/s | 203 kB 00:00 2024-04-26T07:27:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:01.900 INFO:teuthology.orchestra.run.smithi031.stdout:Total 4.2 MB/s | 203 kB 00:00 2024-04-26T07:27:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:27:01.912 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:27:01.913 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:27:01.964 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:27:01.967 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:27:01.999 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:02.000 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:02.000 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:02.000 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:02.000 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:27:02.001 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-26T07:27:02.001 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-26T07:27:02.001 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T07:27:02.001 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:02.001 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:27:02.001 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:02.001 INFO:teuthology.orchestra.run.smithi172.stdout:Install 2 Packages 2024-04-26T07:27:02.001 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:02.002 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 656 k 2024-04-26T07:27:02.002 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 1.8 M 2024-04-26T07:27:02.002 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:27:02.109 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:27:02.263 INFO:teuthology.orchestra.run.smithi172.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 11 MB/s | 572 kB 00:00 2024-04-26T07:27:02.264 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:02.288 INFO:teuthology.orchestra.run.smithi172.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-04-26T07:27:02.289 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:02.289 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.2 MB/s | 656 kB 00:00 2024-04-26T07:27:02.299 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:27:02.319 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:27:02.320 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:27:02.402 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:27:02.405 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:27:02.555 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:17 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:02.585 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:27:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:02.821 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-26T07:27:02.966 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-26T07:27:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:03.083 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:27:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:03.083 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:03.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr 2024-04-26T07:27:03.362 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-26T07:27:03.362 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-26T07:27:03.762 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-26T07:27:03.762 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:03.762 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:27:03.762 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-26T07:27:03.762 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:03.762 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:04.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados-devel 2024-04-26T07:27:04.105 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:16 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:04.295 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:04.348 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:04.349 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:04.350 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:04.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-fuse 2024-04-26T07:27:04.754 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:20 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:05.250 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:20 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:05.820 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:05.874 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:05.875 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:05.875 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:06.408 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:06.408 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:06.408 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:06.408 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:27:06.408 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-26T07:27:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:06.409 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:27:06.409 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:06.409 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-26T07:27:06.409 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:06.409 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 140 k 2024-04-26T07:27:06.409 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 478 k 2024-04-26T07:27:06.409 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:27:06.427 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-fuse 2024-04-26T07:27:06.475 INFO:teuthology.orchestra.run.smithi172.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 2.1 MB/s | 140 kB 00:00 2024-04-26T07:27:06.475 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:06.475 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.1 MB/s | 140 kB 00:00 2024-04-26T07:27:06.476 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:27:06.482 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:27:06.482 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:27:06.529 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:27:06.532 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:27:06.638 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:27:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:07.031 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:07.031 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout:Install 2 Packages 2024-04-26T07:27:07.032 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:07.033 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 656 k 2024-04-26T07:27:07.033 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 1.8 M 2024-04-26T07:27:07.033 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:27:07.102 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:07.188 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:19 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:07.284 INFO:teuthology.orchestra.run.smithi057.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 9.8 MB/s | 572 kB 00:00 2024-04-26T07:27:07.309 INFO:teuthology.orchestra.run.smithi057.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2024-04-26T07:27:07.309 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:07.309 INFO:teuthology.orchestra.run.smithi057.stdout:Total 2.3 MB/s | 656 kB 00:00 2024-04-26T07:27:07.320 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:27:07.342 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:27:07.342 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:27:07.430 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:27:07.434 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:27:07.502 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:07.502 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:07.502 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:27:07.502 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:07.502 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:07.503 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:07.621 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:27:07.734 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs2 2024-04-26T07:27:07.848 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-26T07:27:07.998 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-26T07:27:08.404 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-26T07:27:08.404 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-26T07:27:08.467 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:24 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:08.958 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:08.958 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:08.958 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:08.958 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout:Install 2 Packages 2024-04-26T07:27:08.959 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:08.960 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 656 k 2024-04-26T07:27:08.960 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 1.8 M 2024-04-26T07:27:08.960 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:27:09.211 INFO:teuthology.orchestra.run.smithi031.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 9.6 MB/s | 572 kB 00:00 2024-04-26T07:27:09.227 INFO:teuthology.orchestra.run.smithi031.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-04-26T07:27:09.228 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:09.228 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.4 MB/s | 656 kB 00:00 2024-04-26T07:27:09.238 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:27:09.260 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:27:09.260 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:27:09.348 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:27:09.351 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:27:09.381 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-26T07:27:09.381 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:09.381 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:27:09.381 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-26T07:27:09.381 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:09.381 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:09.530 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:27:09.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados-devel 2024-04-26T07:27:09.746 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-26T07:27:09.896 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-26T07:27:10.080 INFO:teuthology.orchestra.run.smithi172.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:10.128 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:10.129 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:27:10.129 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:10.239 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs-devel 2024-04-26T07:27:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-26T07:27:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-26T07:27:10.417 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:25 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-26T07:27:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:10.816 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:27:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-26T07:27:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:10.816 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:10.967 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:26 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:11.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados-devel 2024-04-26T07:27:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:23 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:12.190 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:12.190 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 140 k 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 478 k 2024-04-26T07:27:12.191 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:27:12.275 INFO:teuthology.orchestra.run.smithi057.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 1.6 MB/s | 140 kB 00:00 2024-04-26T07:27:12.276 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:12.276 INFO:teuthology.orchestra.run.smithi057.stdout:Total 1.6 MB/s | 140 kB 00:00 2024-04-26T07:27:12.276 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:27:12.282 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:27:12.282 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:27:12.332 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:27:12.335 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:27:12.446 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:27:12.614 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 22 k 2024-04-26T07:27:12.615 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 78 k 2024-04-26T07:27:12.616 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:27:12.647 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:12.660 INFO:teuthology.orchestra.run.smithi172.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 489 kB/s | 22 kB 00:00 2024-04-26T07:27:12.661 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:12.661 INFO:teuthology.orchestra.run.smithi172.stdout:Total 475 kB/s | 22 kB 00:00 2024-04-26T07:27:12.661 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:27:12.664 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:27:12.664 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:27:12.666 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:27:12.669 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:27:12.721 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:27:12.888 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:12.948 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:13.153 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:13.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:13.343 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:13.343 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:27:13.343 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:13.343 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:13.343 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:13.499 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:13.499 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:13.499 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:27:13.499 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:13.499 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:13.499 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:13.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs2 2024-04-26T07:27:13.588 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-26T07:27:13.589 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:13.590 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 140 k 2024-04-26T07:27:13.590 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 478 k 2024-04-26T07:27:13.590 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:27:13.631 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados2 2024-04-26T07:27:13.639 INFO:teuthology.orchestra.run.smithi031.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 2.8 MB/s | 140 kB 00:00 2024-04-26T07:27:13.640 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:13.640 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.7 MB/s | 140 kB 00:00 2024-04-26T07:27:13.640 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:27:13.646 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:27:13.646 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:27:13.696 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:27:13.699 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:27:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:27:13.994 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:14.292 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:14.337 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:29 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:14.362 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:30 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:14.686 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:14.686 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:14.686 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:27:14.686 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:14.686 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:14.686 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:14.940 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs2 2024-04-26T07:27:15.708 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:27 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:15.951 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:15.999 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:16.001 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:27:16.001 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:16.044 INFO:teuthology.orchestra.run.smithi057.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:16.098 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:16.099 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:16.099 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:16.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs-devel 2024-04-26T07:27:16.227 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librbd1 2024-04-26T07:27:16.955 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:32 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:16.982 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:31 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:17.419 INFO:teuthology.orchestra.run.smithi031.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:17.471 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:17.472 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:17.472 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:17.621 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs-devel 2024-04-26T07:27:18.376 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:30 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:18.558 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:18.609 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:18.610 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:27:18.610 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:18.720 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rados 2024-04-26T07:27:18.735 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-26T07:27:18.736 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:18.737 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 22 k 2024-04-26T07:27:18.737 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 78 k 2024-04-26T07:27:18.737 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:27:18.790 INFO:teuthology.orchestra.run.smithi057.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 419 kB/s | 22 kB 00:00 2024-04-26T07:27:18.790 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:18.790 INFO:teuthology.orchestra.run.smithi057.stdout:Total 409 kB/s | 22 kB 00:00 2024-04-26T07:27:18.790 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:27:18.794 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:27:18.794 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:27:18.795 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:27:18.799 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:27:18.851 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:27:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:19.444 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:35 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:19.734 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:19.734 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:19.734 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:27:19.734 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:19.734 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:19.734 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:19.897 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados2 2024-04-26T07:27:20.147 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:20.148 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:20.148 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:20.148 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:20.148 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:27:20.148 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-26T07:27:20.148 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:20.149 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:27:20.149 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:20.149 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-26T07:27:20.149 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:20.149 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 22 k 2024-04-26T07:27:20.149 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 78 k 2024-04-26T07:27:20.149 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:27:20.185 INFO:teuthology.orchestra.run.smithi031.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 601 kB/s | 22 kB 00:00 2024-04-26T07:27:20.186 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:20.186 INFO:teuthology.orchestra.run.smithi031.stdout:Total 580 kB/s | 22 kB 00:00 2024-04-26T07:27:20.186 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:27:20.190 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:27:20.190 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:27:20.192 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:27:20.195 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:27:20.241 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:27:20.426 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:20.654 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:35 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:20.699 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:21.054 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:21.081 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:27:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:21.081 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:21.105 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:21.106 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:27:21.106 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:21.216 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados2 2024-04-26T07:27:21.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rgw 2024-04-26T07:27:21.945 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:37 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:21.973 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:33 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:22.373 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:22.424 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:22.426 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:22.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librbd1 2024-04-26T07:27:23.310 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:38 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:23.569 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:23.619 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:23.621 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:27:23.621 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:23.683 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:23.731 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:23.732 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:23.732 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:23.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-cephfs 2024-04-26T07:27:23.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librbd1 2024-04-26T07:27:24.477 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:40 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:24.592 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:36 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:25.024 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:25.077 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:25.078 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:25.078 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:25.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rados 2024-04-26T07:27:26.085 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:26.134 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:26.135 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:27:26.135 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:26.253 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rbd 2024-04-26T07:27:26.303 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:26.355 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:26.356 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:26.357 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:26.364 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:41 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:26.457 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rados 2024-04-26T07:27:26.980 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:42 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:27.214 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:39 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:28.127 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:28.128 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:28.129 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:28.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rgw 2024-04-26T07:27:28.569 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:28.619 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:28.620 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:27:28.620 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:28.732 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-fuse 2024-04-26T07:27:28.927 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:28.979 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:28.980 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:28.980 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:29.008 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:44 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:29.087 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rgw 2024-04-26T07:27:29.459 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:45 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:29.848 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:41 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:30.729 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:30.780 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:30.782 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:30.782 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:30.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-cephfs 2024-04-26T07:27:31.097 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:31.098 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:31.098 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:31.098 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:31.098 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:27:31.098 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-26T07:27:31.098 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:31.098 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:27:31.099 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:31.099 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-26T07:27:31.099 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:31.099 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 73 k 2024-04-26T07:27:31.099 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 188 k 2024-04-26T07:27:31.099 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:27:31.147 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.5 MB/s | 73 kB 00:00 2024-04-26T07:27:31.148 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:31.148 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.5 MB/s | 73 kB 00:00 2024-04-26T07:27:31.148 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:27:31.157 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:27:31.157 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:27:31.204 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:27:31.207 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:27:31.309 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:27:31.510 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:31.632 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:31.634 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:31.634 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:31.667 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:46 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:31.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-cephfs 2024-04-26T07:27:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:32.164 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:32.164 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:32.164 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:27:32.165 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:32.165 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:32.165 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:32.389 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-mirror 2024-04-26T07:27:32.513 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:44 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:33.131 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:49 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:33.392 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:33.444 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:33.445 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:33.445 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:33.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rbd 2024-04-26T07:27:34.248 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:34.303 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:34.304 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:34.304 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:34.325 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:49 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:34.412 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rbd 2024-04-26T07:27:34.778 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:34.779 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-26T07:27:34.780 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:34.780 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 2.7 M 2024-04-26T07:27:34.780 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 9.8 M 2024-04-26T07:27:34.780 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:27:34.866 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 32 MB/s | 2.7 MB 00:00 2024-04-26T07:27:34.866 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:34.866 INFO:teuthology.orchestra.run.smithi172.stdout:Total 31 MB/s | 2.7 MB 00:00 2024-04-26T07:27:34.867 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:27:34.878 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:27:34.878 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:27:34.935 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:27:34.938 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:27:35.168 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:47 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:35.272 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:27:35.462 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:35.889 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:36.037 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:36.089 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:36.090 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:36.090 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:36.209 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-fuse 2024-04-26T07:27:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:36.279 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:27:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:36.280 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:36.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-nbd 2024-04-26T07:27:36.878 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:36.930 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:36.932 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:36.932 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:36.966 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:51 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:37.039 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-fuse 2024-04-26T07:27:37.247 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:53 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:37.797 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:49 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:38.754 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:38.755 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:38.755 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:38.755 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:38.755 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:27:38.755 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-26T07:27:38.755 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:38.756 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:27:38.756 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:38.756 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-26T07:27:38.756 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:38.756 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 73 k 2024-04-26T07:27:38.756 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 188 k 2024-04-26T07:27:38.756 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:27:38.818 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.2 MB/s | 73 kB 00:00 2024-04-26T07:27:38.819 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:38.819 INFO:teuthology.orchestra.run.smithi057.stdout:Total 1.1 MB/s | 73 kB 00:00 2024-04-26T07:27:38.819 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:27:38.829 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:27:38.829 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:27:38.880 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:27:38.883 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:27:38.909 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:38.909 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:38.909 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:38.909 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:38.909 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-26T07:27:38.910 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-26T07:27:38.910 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:38.910 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-26T07:27:38.910 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-26T07:27:38.910 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-26T07:27:38.910 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:38.910 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 140 k 2024-04-26T07:27:38.911 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 418 k 2024-04-26T07:27:38.911 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-26T07:27:38.959 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 2.8 MB/s | 140 kB 00:00 2024-04-26T07:27:38.960 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:38.960 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.7 MB/s | 140 kB 00:00 2024-04-26T07:27:38.960 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-26T07:27:38.970 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-26T07:27:38.970 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-26T07:27:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:27:39.016 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-26T07:27:39.019 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-26T07:27:39.122 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-26T07:27:39.152 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:39.318 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:39.734 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:39.735 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:39.737 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 73 k 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 188 k 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.5 MB/s | 73 kB 00:00 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Total 1.5 MB/s | 73 kB 00:00 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:27:39.738 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:27:39.775 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:27:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:39.912 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:27:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:39.912 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:39.948 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:39.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:39.979 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:39.980 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-26T07:27:39.980 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:39.980 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:39.980 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:40.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-mirror 2024-04-26T07:27:40.228 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados2 2024-04-26T07:27:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:40.633 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:40.634 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:40.634 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:27:40.634 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:40.634 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:40.634 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:40.865 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-mirror 2024-04-26T07:27:40.954 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:55 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:40.959 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:56 ago on Fri 26 Apr 2024 07:25:44 AM UTC. 2024-04-26T07:27:41.619 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:53 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:42.541 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:42.589 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-26T07:27:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-26T07:27:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-26T07:27:42.702 DEBUG:teuthology.parallel:result is None 2024-04-26T07:27:42.721 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:42.722 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-26T07:27:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:42.723 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 2.7 M 2024-04-26T07:27:42.723 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 9.8 M 2024-04-26T07:27:42.723 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:27:42.812 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 30 MB/s | 2.7 MB 00:00 2024-04-26T07:27:42.813 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:42.813 INFO:teuthology.orchestra.run.smithi057.stdout:Total 29 MB/s | 2.7 MB 00:00 2024-04-26T07:27:42.813 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:27:42.825 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:27:42.826 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:27:42.886 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:27:42.889 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:27:43.244 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:27:43.397 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:43.398 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:43.398 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:43.398 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:43.398 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:27:43.398 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-26T07:27:43.398 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:43.398 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:27:43.398 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:43.399 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-26T07:27:43.399 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:43.399 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 2.7 M 2024-04-26T07:27:43.399 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 9.8 M 2024-04-26T07:27:43.399 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:27:43.410 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:43.466 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 41 MB/s | 2.7 MB 00:00 2024-04-26T07:27:43.467 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:43.467 INFO:teuthology.orchestra.run.smithi031.stdout:Total 40 MB/s | 2.7 MB 00:00 2024-04-26T07:27:43.467 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:27:43.479 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:27:43.479 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:27:43.542 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:27:43.543 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:27:43.843 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:27:44.217 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:44.218 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:44.218 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:27:44.218 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:44.218 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:44.218 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:44.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-nbd 2024-04-26T07:27:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:45.168 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:27:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:45.168 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:45.236 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:00 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:45.386 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-nbd 2024-04-26T07:27:46.150 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:58 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:47.005 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-26T07:27:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:47.007 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 140 k 2024-04-26T07:27:47.007 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 418 k 2024-04-26T07:27:47.007 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-26T07:27:47.056 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 2.8 MB/s | 140 kB 00:00 2024-04-26T07:27:47.057 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:47.057 INFO:teuthology.orchestra.run.smithi057.stdout:Total 2.7 MB/s | 140 kB 00:00 2024-04-26T07:27:47.058 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-26T07:27:47.068 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-26T07:27:47.068 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-26T07:27:47.117 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-26T07:27:47.120 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-26T07:27:47.374 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-26T07:27:47.541 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:47.925 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:47.926 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:47.926 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-26T07:27:47.926 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 140 k 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 418 k 2024-04-26T07:27:47.927 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-26T07:27:48.017 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 1.5 MB/s | 140 kB 00:00 2024-04-26T07:27:48.018 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-26T07:27:48.018 INFO:teuthology.orchestra.run.smithi031.stdout:Total 1.5 MB/s | 140 kB 00:00 2024-04-26T07:27:48.018 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-26T07:27:48.028 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-26T07:27:48.029 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-26T07:27:48.078 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-26T07:27:48.081 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-26T07:27:48.188 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-26T07:27:48.278 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:48.278 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:48.278 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-26T07:27:48.279 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:48.279 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:48.279 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:48.397 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:48.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados2 2024-04-26T07:27:48.695 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:49.077 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-26T07:27:49.077 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:49.077 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-26T07:27:49.077 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-26T07:27:49.077 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:49.077 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:49.308 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:04 ago on Fri 26 Apr 2024 07:25:45 AM UTC. 2024-04-26T07:27:49.323 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados2 2024-04-26T07:27:50.084 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:02:02 ago on Fri 26 Apr 2024 07:25:48 AM UTC. 2024-04-26T07:27:51.020 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:51.074 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-26T07:27:51.075 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-26T07:27:51.076 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-26T07:27:51.200 DEBUG:teuthology.parallel:result is None 2024-04-26T07:27:51.830 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-26T07:27:51.882 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:27:51.883 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:27:51.883 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:27:51.993 DEBUG:teuthology.parallel:result is None 2024-04-26T07:27:51.994 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:27:51.994 INFO:teuthology.packaging:ref: None 2024-04-26T07:27:51.994 INFO:teuthology.packaging:tag: None 2024-04-26T07:27:51.994 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:27:51.994 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:27:51.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-26T07:27:52.280 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T07:27:52.303 INFO:teuthology.orchestra.run.smithi031.stdout:15.2.17-0.el8 2024-04-26T07:27:52.304 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-26T07:27:52.304 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-26T07:27:52.306 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:27:52.306 INFO:teuthology.packaging:ref: None 2024-04-26T07:27:52.306 INFO:teuthology.packaging:tag: None 2024-04-26T07:27:52.306 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:27:52.306 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:27:52.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-26T07:27:52.509 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T07:27:52.536 INFO:teuthology.orchestra.run.smithi057.stdout:15.2.17-0.el8 2024-04-26T07:27:52.537 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-26T07:27:52.537 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-26T07:27:52.539 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:27:52.539 INFO:teuthology.packaging:ref: None 2024-04-26T07:27:52.539 INFO:teuthology.packaging:tag: None 2024-04-26T07:27:52.539 INFO:teuthology.packaging:branch: octopus 2024-04-26T07:27:52.539 INFO:teuthology.packaging:sha1: 19b26365dac54ee709df8c5dc2a7b7e89a50aba5 2024-04-26T07:27:52.539 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-26T07:27:52.749 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T07:27:52.776 INFO:teuthology.orchestra.run.smithi172.stdout:15.2.17-0.el8 2024-04-26T07:27:52.776 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-26T07:27:52.776 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-26T07:27:52.778 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T07:27:52.779 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:52.779 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T07:27:52.810 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:27:52.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T07:27:52.844 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:27:52.844 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T07:27:52.876 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T07:27:52.876 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:52.876 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T07:27:52.907 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T07:27:52.978 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:27:52.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T07:27:53.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T07:27:53.083 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:27:53.084 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T07:27:53.115 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T07:27:53.187 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T07:27:53.187 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:53.187 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T07:27:53.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T07:27:53.287 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:27:53.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T07:27:53.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T07:27:53.394 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:27:53.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T07:27:53.427 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T07:27:53.496 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T07:27:53.496 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:53.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T07:27:53.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T07:27:53.599 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:27:53.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T07:27:53.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T07:27:53.707 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:27:53.707 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T07:27:53.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T07:27:53.806 INFO:teuthology.run_tasks:Running task print... 2024-04-26T07:27:53.816 INFO:teuthology.task.print:**** done installing octopus 2024-04-26T07:27:53.816 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T07:27:53.909 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T07:27:53.910 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-04-26T07:27:53.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-04-26T07:27:53.914 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-04-26T07:27:53.945 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T07:27:53.945 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T07:27:53.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T07:27:53.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T07:27:54.019 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T07:27:54.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T07:27:54.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T07:27:54.062 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T07:27:54.103 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T07:27:54.103 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T07:27:54.104 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592', 'branch': 'reef', 'description': 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672592', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/octopus latest\n'}], 'name': 'teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'cephfs': {'max_mds': 2}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5'}}, 'nuke-on-error': False, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'seed': 7931, 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5', 'sleep_before_teardown': 0, 'subset': '126/512', 'suite': 'fs', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_dc093b5e41f728edab6e0330295fdf9156d31664/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXNea/KEGI0biH9nwfd1+ZxxINa/CFnQsnz+RQJrOkbqnWjHGRfyyCZUGsb7Mg7ou5z2kiiZYciRM15JIWV8Lg=', 'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFiC80bvCyu10EwKwE4LxD1tqqbzMWDQPSDNmFF2xrPhmFxfYlr8tZZQx6q7C0dShHrEWQaTZX0549YxF1ZBs/0=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCf/hw3lSaVa92J9J6B40z+bYQvWjga5QfSO0I9xle6q5/6fhdKZnd/MhDfl/Nx0tOb++poz+DAMAHemjQ+hAIY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5'}}, {'print': '**** done installing octopus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cephfs': {'max_mds': 2}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client octopus']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done octopus client'}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'quincy'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph osd require-osd-release quincy', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'install.upgrade': {'client.0': {'branch': 'quincy'}}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': {'mounted': False}, 'client.1': {'skip': True}}}, {'ceph-fuse': {'client.0': None, 'client.1': {'skip': True}}}, {'print': '**** done remount client'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs required_client_features cephfs add metric_collect']}}, {'sleep': {'duration': 5}}, {'fs.clients_evicted': {'clients': {'client.0': False, 'client.1': True}}}, {'workunit': {'clients': {'client.0': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_22:24:15', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T07:27:54.104 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T07:27:54.131 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T07:27:54.135 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T07:27:54.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T07:27:54.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T07:27:54.198 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T07:27:54.229 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:54.229 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T07:27:54.279 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T07:27:54.279 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-04-26T07:27:54.338 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T07:27:54.339 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:27:54.339 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 169290 Links: 1 2024-04-26T07:27:54.339 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:27:54.339 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:27:54.339 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-26 07:27:44.460401438 +0000 2024-04-26T07:27:54.339 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-26 07:24:49.734808625 +0000 2024-04-26T07:27:54.339 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-26 07:24:49.734808625 +0000 2024-04-26T07:27:54.339 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-26T07:27:54.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T07:27:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-26T07:27:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-26T07:27:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000223032 s, 2.3 MB/s 2024-04-26T07:27:54.408 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T07:27:54.469 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-04-26T07:27:54.529 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T07:27:54.529 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:27:54.530 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 169400 Links: 1 2024-04-26T07:27:54.530 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:27:54.530 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:27:54.530 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-26 07:27:44.460401438 +0000 2024-04-26T07:27:54.530 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-26 07:24:50.063803383 +0000 2024-04-26T07:27:54.530 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-26 07:24:50.063803383 +0000 2024-04-26T07:27:54.530 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-26T07:27:54.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T07:27:54.598 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-26T07:27:54.598 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-26T07:27:54.598 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000196864 s, 2.6 MB/s 2024-04-26T07:27:54.599 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T07:27:54.659 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-04-26T07:27:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T07:27:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:27:54.719 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 169455 Links: 1 2024-04-26T07:27:54.719 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:27:54.719 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:27:54.719 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-26 07:27:44.461401423 +0000 2024-04-26T07:27:54.720 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-26 07:24:50.578795178 +0000 2024-04-26T07:27:54.720 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-26 07:24:50.578795178 +0000 2024-04-26T07:27:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-26T07:27:54.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T07:27:54.786 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-26T07:27:54.786 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-26T07:27:54.786 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.00017651 s, 2.9 MB/s 2024-04-26T07:27:54.787 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T07:27:54.846 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-04-26T07:27:54.904 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T07:27:54.905 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:27:54.905 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 169498 Links: 1 2024-04-26T07:27:54.905 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:27:54.905 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T07:27:54.905 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-26 07:27:44.461401423 +0000 2024-04-26T07:27:54.905 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-26 07:24:50.933789522 +0000 2024-04-26T07:27:54.905 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-26 07:24:50.933789522 +0000 2024-04-26T07:27:54.905 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-26T07:27:54.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T07:27:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-26T07:27:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-26T07:27:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000203114 s, 2.5 MB/s 2024-04-26T07:27:54.972 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T07:27:55.031 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:27:55.031 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-26T07:27:55.031 INFO:tasks.ceph:Generating config... 2024-04-26T07:27:55.032 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-04-26T07:27:55.032 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-04-26T07:27:55.032 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2024-04-26T07:27:55.032 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2024-04-26T07:27:55.033 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-04-26T07:27:55.033 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T07:27:55.033 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T07:27:55.033 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T07:27:55.033 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T07:27:55.033 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T07:27:55.033 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T07:27:55.033 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T07:27:55.033 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T07:27:55.034 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T07:27:55.035 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T07:27:55.035 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T07:27:55.035 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T07:27:55.035 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T07:27:55.035 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T07:27:55.035 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T07:27:55.036 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T07:27:55.036 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T07:27:55.036 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T07:27:55.036 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T07:27:55.036 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T07:27:55.036 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T07:27:55.036 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T07:27:55.205 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T07:27:55.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T07:27:55.249 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:27:55.317 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]'), ('mon.c', '[v2:172.21.15.31:3302,v1:172.21.15.31:6791]')] 2024-04-26T07:27:55.318 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790],[v2:172.21.15.31:3302,v1:172.21.15.31:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T07:27:55.318 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:55.318 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T07:27:55.376 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --addv b '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]' --addv c '[v2:172.21.15.31:3302,v1:172.21.15.31:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:27:55.460 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid 1efcad47-d196-4e33-a2f1-15c92eeb84f0 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:fsid 1efcad47-d196-4e33-a2f1-15c92eeb84f0 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-04-26T07:27:55.461032+0000 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-04-26T07:27:55.461032+0000 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 0 (unknown) 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] mon.b 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] mon.c 2024-04-26T07:27:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T07:27:55.463 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T07:27:55.480 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1efcad47-d196-4e33-a2f1-15c92eeb84f0... 2024-04-26T07:27:55.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T07:27:55.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T07:27:55.525 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T07:27:55.566 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-04-26T07:27:55.566 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-04-26T07:27:55.567 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-04-26T07:27:55.568 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-04-26T07:27:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-04-26T07:27:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-04-26T07:27:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-04-26T07:27:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790],[v2:172.21.15.31:3302,v1:172.21.15.31:6791]" 2024-04-26T07:27:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on pool no app = False 2024-04-26T07:27:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: ms bind msgr2 = False 2024-04-26T07:27:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore warn on legacy statfs = False 2024-04-26T07:27:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore warn on no per pool omap = False 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn min per osd = 0 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 1efcad47-d196-4e33-a2f1-15c92eeb84f0 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-04-26T07:27:55.572 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2024-04-26T07:27:55.573 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:27:55.574 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T07:27:55.575 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = False 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-04-26T07:27:55.576 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-04-26T07:27:55.577 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-04-26T07:27:55.578 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-04-26T07:27:55.579 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-04-26T07:27:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-04-26T07:27:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T07:27:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-04-26T07:27:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-04-26T07:27:55.579 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.580 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-04-26T07:27:55.581 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790],[v2:172.21.15.31:3302,v1:172.21.15.31:6791]" 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on pool no app = False 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: ms bind msgr2 = False 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore warn on legacy statfs = False 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore warn on no per pool omap = False 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn min per osd = 0 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 1efcad47-d196-4e33-a2f1-15c92eeb84f0 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.582 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-04-26T07:27:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2024-04-26T07:27:55.584 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-04-26T07:27:55.585 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:27:55.586 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-04-26T07:27:55.587 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-04-26T07:27:55.588 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = False 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2024-04-26T07:27:55.589 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-04-26T07:27:55.590 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T07:27:55.591 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-26T07:27:55.592 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T07:27:55.593 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-26T07:27:55.594 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790],[v2:172.21.15.31:3302,v1:172.21.15.31:6791]" 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on pool no app = False 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: ms bind msgr2 = False 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore warn on legacy statfs = False 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore warn on no per pool omap = False 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn min per osd = 0 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 1efcad47-d196-4e33-a2f1-15c92eeb84f0 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.595 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-26T07:27:55.596 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-26T07:27:55.597 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-26T07:27:55.598 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-26T07:27:55.599 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-26T07:27:55.600 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T07:27:55.601 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = False 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2024-04-26T07:27:55.602 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2024-04-26T07:27:55.603 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2024-04-26T07:27:55.604 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2024-04-26T07:27:55.604 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-26T07:27:55.604 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-26T07:27:55.604 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-26T07:27:55.606 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T07:27:55.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T07:27:55.697 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T07:27:55.697 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:55.697 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T07:27:55.715 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:55.716 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T07:27:55.774 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:27:55.774 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:55.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T07:27:55.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:27:55.850 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:27:55.851 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:27:55.909 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-04-26T07:27:55.909 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:27:55.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T07:27:55.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:27:55.954 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:27:55.954 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:27:56.015 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T07:27:56.015 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:27:56.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T07:27:56.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:27:56.059 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:27:56.059 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:27:56.119 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T07:27:56.120 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T07:27:56.120 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T07:27:56.171 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T07:27:56.173 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T07:27:56.223 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T07:27:56.226 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T07:27:56.226 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T07:27:56.276 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T07:27:56.278 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T07:27:56.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T07:27:56.396 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T07:27:56.398 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T07:27:56.426 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T07:27:56.515 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T07:27:56.517 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T07:27:56.545 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T07:27:56.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T07:27:56.681 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T07:27:56.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T07:27:56.817 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T07:27:56.830 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T07:27:56.830 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-26T07:27:56.831 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T07:27:56.859 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:27:56.859 INFO:tasks.ceph:role: osd.0 2024-04-26T07:27:56.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:27:56.859 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T07:27:56.934 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:27:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:27:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:27:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:27:56.934 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:27:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:27:56.935 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:27:56.935 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:27:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:27:56.935 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:27:57.357 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-26T07:27:57.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-26T07:27:57.359 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T07:27:57.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T07:27:57.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T07:27:57.634 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:27:57.635 INFO:tasks.ceph:role: osd.1 2024-04-26T07:27:57.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:27:57.635 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T07:27:57.712 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:27:57.712 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:27:57.713 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:27:57.713 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:27:57.713 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:27:57.713 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:27:57.713 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:27:57.713 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:27:57.713 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:27:57.713 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:27:58.133 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-26T07:27:58.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-26T07:27:58.135 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T07:27:58.243 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T07:27:58.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T07:27:58.350 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:27:58.351 INFO:tasks.ceph:role: osd.2 2024-04-26T07:27:58.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:27:58.351 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T07:27:58.428 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:27:58.428 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:27:58.428 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:27:58.428 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:27:58.428 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:27:58.428 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:27:58.429 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:27:58.429 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:27:58.429 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:27:58.429 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:27:58.877 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-26T07:27:58.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-26T07:27:58.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T07:27:59.032 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T07:27:59.071 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T07:27:59.143 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:27:59.143 INFO:tasks.ceph:role: osd.3 2024-04-26T07:27:59.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:27:59.144 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T07:27:59.222 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:27:59.222 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:27:59.222 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:27:59.223 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:27:59.223 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:27:59.223 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:27:59.223 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:27:59.223 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:27:59.223 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:27:59.223 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:27:59.665 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-26T07:27:59.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-26T07:27:59.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T07:27:59.834 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T07:27:59.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:27:59.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:27:59.973+0000 7f7858982f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T07:27:59.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:27:59.973+0000 7f7858982f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T07:27:59.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:27:59.973+0000 7f7858982f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:27:59.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:27:59.973+0000 7f7858982f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:27:59.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:27:59.973+0000 7f7858982f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:27:59.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:27:59.974+0000 7f7858982f00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T07:27:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:27:59.987+0000 7f7858982f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-26T07:28:02.302 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T07:28:02.336 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:28:02.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:02.426+0000 7f73a6e0bf00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T07:28:02.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:02.426+0000 7f73a6e0bf00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T07:28:02.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:02.426+0000 7f73a6e0bf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:28:02.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:02.426+0000 7f73a6e0bf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:28:02.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:02.426+0000 7f73a6e0bf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:28:02.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:02.427+0000 7f73a6e0bf00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T07:28:02.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:02.435+0000 7f73a6e0bf00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-26T07:28:04.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T07:28:04.809 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:28:04.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:04.899+0000 7f5ffb3cbf00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T07:28:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:04.899+0000 7f5ffb3cbf00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T07:28:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:04.899+0000 7f5ffb3cbf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:28:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:04.899+0000 7f5ffb3cbf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:28:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:04.899+0000 7f5ffb3cbf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:28:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:04.899+0000 7f5ffb3cbf00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T07:28:04.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:04.908+0000 7f5ffb3cbf00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-26T07:28:07.247 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T07:28:07.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:28:07.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:07.371+0000 7fc1c0d43f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T07:28:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:07.371+0000 7fc1c0d43f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T07:28:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:07.371+0000 7fc1c0d43f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:28:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:07.371+0000 7fc1c0d43f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:28:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:07.371+0000 7fc1c0d43f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:28:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:07.372+0000 7fc1c0d43f00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T07:28:07.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:07.379+0000 7fc1c0d43f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-26T07:28:09.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T07:28:09.740 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T07:28:09.741 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:09.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T07:28:09.813 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:09.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T07:28:09.886 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:09.886 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T07:28:09.959 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:09.959 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T07:28:10.029 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:10.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T07:28:10.099 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:10.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T07:28:10.169 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:10.169 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T07:28:10.237 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:10.238 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T07:28:10.306 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:10.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T07:28:10.375 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:28:10.375 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T07:28:10.398 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:28:10.398 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T07:28:10.421 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T07:28:10.421 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T07:28:10.448 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-04-26T07:28:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB8VytmWus6ChAAgCuP29zgbohRggPcLEVyhw== 2024-04-26T07:28:10.448 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2024-04-26T07:28:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB8VytmikNdDRAAh/l46HBIty+ywp4XHRzWkA== 2024-04-26T07:28:10.448 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-04-26T07:28:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB8VytmyMeDEBAAPNNxkTblLvTP5MPCO8nRqg== 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB8VytmQ5itFxAAFPonVSxR0GZ5MKVSU9XY6w== 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB8VytmJnvGHhAA2UlfpWaw/WK30Ie8JV//kg== 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB/VytmtuIOOhAA861jeSMyXiovVowOOo/TWQ== 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCCVytmuBVyGRAAeXL2cD4QQKswuSPBKs9MBg== 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCEVytmbQqgNRAA23w8FakYO3jK2yli5gxfmw== 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCHVytm0OkvFhAAk3hNo/uUF+P0NHFVLOdGJw== 2024-04-26T07:28:10.449 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-04-26T07:28:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB8Vytm/mWuKBAALyJe7LgbOQGuyM5I8mv7uw== 2024-04-26T07:28:10.450 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2024-04-26T07:28:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB8Vytmd4e8MBAAIwGdEaHzD+pSfwNRrknGNA== 2024-04-26T07:28:10.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T07:28:10.541 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T07:28:10.590 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T07:28:10.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T07:28:10.693 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T07:28:10.744 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:28:10.793 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:28:10.842 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:28:10.891 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:28:10.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T07:28:10.991 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T07:28:11.042 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T07:28:11.042 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T07:28:11.069 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T07:28:11.163 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T07:28:11.191 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T07:28:11.258 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T07:28:11.354 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T07:28:11.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T07:28:11.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T07:28:11.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T07:28:11.569 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:28:11.628 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T07:28:11.628 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T07:28:11.628 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T07:28:11.670 INFO:tasks.ceph.mon.a:Started 2024-04-26T07:28:11.670 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T07:28:11.670 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T07:28:11.672 INFO:tasks.ceph.mon.b:Started 2024-04-26T07:28:11.672 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T07:28:11.672 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T07:28:11.674 INFO:tasks.ceph.mon.c:Started 2024-04-26T07:28:11.674 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T07:28:11.674 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T07:28:11.674 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T07:28:11.676 INFO:tasks.ceph.mgr.x:Started 2024-04-26T07:28:11.677 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T07:28:11.677 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T07:28:11.679 INFO:tasks.ceph.mgr.y:Started 2024-04-26T07:28:11.679 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T07:28:11.679 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T07:28:11.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.805+0000 7fe2c8d0d700 1 Processor -- start 2024-04-26T07:28:11.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.805+0000 7fe2c8d0d700 1 -- start start 2024-04-26T07:28:11.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.805+0000 7fe2c8d0d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c40a2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:11.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.805+0000 7fe2c8d0d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c41338e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:11.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.805+0000 7fe2c8d0d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c40a2920 con 0x7fe2c4136350 2024-04-26T07:28:11.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.805+0000 7fe2c8d0d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40a1ce0 con 0x7fe2c40a4350 2024-04-26T07:28:11.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.805+0000 7fe2c8d0d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c4060680 con 0x7fe2c4133500 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c40a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c40a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52386/0 (socket says 172.21.15.31:52386) 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c1d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c41338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c259c700 1 -- 172.21.15.31:0/3128774198 learned_addr learned my addr 172.21.15.31:0/3128774198 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c259c700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 msgr2=0x7fe2c40a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c259c700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 msgr2=0x7fe2c40a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c259c700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c40a2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c1d9b700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 msgr2=0x7fe2c41338e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c1d9b700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 msgr2=0x7fe2c41338e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c1d9b700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c41338e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c259c700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c40a2430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-26T07:28:11.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.806+0000 7fe2c1d9b700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c41338e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-26T07:28:11.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.849+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856485278 0 0) 0x7fe2bc001490 con 0x7fe2c4136350 2024-04-26T07:28:11.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.849+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a4003260 con 0x7fe2c4136350 2024-04-26T07:28:11.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1832825923 0 0) 0x7fe2a4003260 con 0x7fe2c4136350 2024-04-26T07:28:11.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 msgr2=0x7fe2c40a2430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c40a2430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 msgr2=0x7fe2c41338e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c41338e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c40a0060 con 0x7fe2c4136350 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1596901407 0 0) 0x7fe2bc001b70 con 0x7fe2c4136350 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 >> v1:172.21.15.31:6789/0 conn(0x7fe2c4136350 legacy=0x7fe2c4136800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2a4003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2a4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c4060680 con 0x7fe2a4004500 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4005020 con 0x7fe2c40a4350 2024-04-26T07:28:11.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a40051e0 con 0x7fe2c4133500 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c259c700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2a4003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c1d9b700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c2d9d700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2a4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c259c700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 msgr2=0x7fe2a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c259c700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c259c700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 msgr2=0x7fe2a4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c259c700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2a4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c259c700 1 -- 172.21.15.31:0/3128774198 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4003260 con 0x7fe2c4133500 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c1d9b700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2a4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c2d9d700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2a4004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.850+0000 7fe2c259c700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2a4003750 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fe2ac000e90 tx=0x7fe2ac00c040).ready entity=mon.2 client_cookie=bc8001c5fdeba3c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.852+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac0118c0 con 0x7fe2c4133500 2024-04-26T07:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.852+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac011a20 con 0x7fe2c4133500 2024-04-26T07:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.852+0000 7fe2c159a700 1 -- 172.21.15.31:0/3128774198 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac011d80 con 0x7fe2c4133500 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 msgr2=0x7fe2a4003750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2a4003750 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fe2ac000e90 tx=0x7fe2ac00c040).stop 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/3128774198 shutdown_connections 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2a4004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2a4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 --2- 172.21.15.31:0/3128774198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2a4003750 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/3128774198 >> 172.21.15.31:0/3128774198 conn(0x7fe2c40a9370 msgr2=0x7fe2c40a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/3128774198 shutdown_connections 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.853+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/3128774198 wait complete. 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c8d0d700 1 Processor -- start 2024-04-26T07:28:11.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c8d0d700 1 -- start start 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c8d0d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2c4067080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c8d0d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c4065a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c8d0d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c4141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c8d0d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40666c0 con 0x7fe2a4004500 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c8d0d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c4067bc0 con 0x7fe2c40a4350 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c8d0d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c4141160 con 0x7fe2c4133500 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2c4067080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c2d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c4141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c2d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c4141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52406/0 (socket says 172.21.15.31:52406) 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2c4067080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53522/0 (socket says 172.21.15.31:53522) 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c2d9d700 1 -- 172.21.15.31:0/1487771200 learned_addr learned my addr 172.21.15.31:0/1487771200 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.854+0000 7fe2c1d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c4065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c259c700 1 -- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 msgr2=0x7fe2c4141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c259c700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c4141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c259c700 1 -- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 msgr2=0x7fe2c4065a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c259c700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c4065a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c259c700 1 -- 172.21.15.31:0/1487771200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c40669a0 con 0x7fe2a4004500 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c1d9b700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c4065a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c2d9d700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c4141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c259c700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2c4067080 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fe2ac000e90 tx=0x7fe2ac00c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2bb7fe700 1 -- 172.21.15.31:0/1487771200 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac00d650 con 0x7fe2a4004500 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2bb7fe700 1 -- 172.21.15.31:0/1487771200 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac017db0 con 0x7fe2a4004500 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c40a5890 con 0x7fe2a4004500 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2bb7fe700 1 -- 172.21.15.31:0/1487771200 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac0225e0 con 0x7fe2a4004500 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c4065ef0 con 0x7fe2a4004500 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2bb7fe700 1 -- 172.21.15.31:0/1487771200 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fe2ac028030 con 0x7fe2a4004500 2024-04-26T07:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.855+0000 7fe2bb7fe700 1 -- 172.21.15.31:0/1487771200 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe2ac02b7a0 con 0x7fe2a4004500 2024-04-26T07:28:11.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.856+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c40661a0 con 0x7fe2a4004500 2024-04-26T07:28:11.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.858+0000 7fe2bb7fe700 1 -- 172.21.15.31:0/1487771200 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe2ac030060 con 0x7fe2a4004500 2024-04-26T07:28:11.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.927+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe2c4066620 con 0x7fe2a4004500 2024-04-26T07:28:11.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.931+0000 7fe2bb7fe700 1 -- 172.21.15.31:0/1487771200 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe2ac026070 con 0x7fe2a4004500 2024-04-26T07:28:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.932+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 msgr2=0x7fe2c4067080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.932+0000 7fe2c8d0d700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2c4067080 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fe2ac000e90 tx=0x7fe2ac00c040).stop 2024-04-26T07:28:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.933+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 shutdown_connections 2024-04-26T07:28:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.933+0000 7fe2c8d0d700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2c4133500 0x7fe2c4141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.933+0000 7fe2c8d0d700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a4004500 0x7fe2c4067080 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.933+0000 7fe2c8d0d700 1 --2- 172.21.15.31:0/1487771200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2c40a4350 0x7fe2c4065a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.933+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 >> 172.21.15.31:0/1487771200 conn(0x7fe2c40a9370 msgr2=0x7fe2c41342c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.933+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 shutdown_connections 2024-04-26T07:28:11.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:11.933+0000 7fe2c8d0d700 1 -- 172.21.15.31:0/1487771200 wait complete. 2024-04-26T07:28:11.935 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-04-26T07:28:11.946 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T07:28:11.946 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T07:28:11.946 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:11.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T07:28:11.975 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:11.975 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T07:28:12.043 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:12.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T07:28:12.112 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:28:12.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T07:28:12.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 996fe73f-646a-43ac-8ab7-64432ddb26f9 0 2024-04-26T07:28:12.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.329+0000 7fb10f3d8700 1 Processor -- start 2024-04-26T07:28:12.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.329+0000 7fb10f3d8700 1 -- start start 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10f3d8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb108139c10 0x7fb108139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10f3d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1080a99b0 0x7fb108063320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10f3d8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb108062a40 con 0x7fb10805b970 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10f3d8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10813a4e0 con 0x7fb108139c10 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10f3d8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108139770 con 0x7fb1080a99b0 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10c973700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1080a99b0 0x7fb108063320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10c973700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1080a99b0 0x7fb108063320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52198/0 (socket says 172.21.15.31:52198) 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10c973700 1 -- 172.21.15.31:0/1589044309 learned_addr learned my addr 172.21.15.31:0/1589044309 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10d174700 1 --2- 172.21.15.31:0/1589044309 >> v2:172.21.15.31:3300/0 conn(0x7fb108139c10 0x7fb108139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb0f7fff700 1 -- 172.21.15.31:0/1589044309 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281266944 0 0) 0x7fb108062a40 con 0x7fb10805b970 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10c973700 1 -- 172.21.15.31:0/1589044309 >> v2:172.21.15.31:3300/0 conn(0x7fb108139c10 msgr2=0x7fb108139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:12.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10c973700 1 --2- 172.21.15.31:0/1589044309 >> v2:172.21.15.31:3300/0 conn(0x7fb108139c10 0x7fb108139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10c973700 1 -- 172.21.15.31:0/1589044309 >> v1:172.21.15.31:6789/0 conn(0x7fb10805b970 legacy=0x7fb10805be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10c973700 1 -- 172.21.15.31:0/1589044309 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb108139a10 con 0x7fb1080a99b0 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10c973700 1 --2- 172.21.15.31:0/1589044309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1080a99b0 0x7fb108063320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fb0f8002f70 tx=0x7fb0f8006e50).ready entity=mon.1 client_cookie=553e46a20226aedd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.330+0000 7fb10d174700 1 --2- 172.21.15.31:0/1589044309 >> v2:172.21.15.31:3300/0 conn(0x7fb108139c10 0x7fb108139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb0f7fff700 1 -- 172.21.15.31:0/1589044309 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f800d5c0 con 0x7fb1080a99b0 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb0f7fff700 1 -- 172.21.15.31:0/1589044309 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8000e90 con 0x7fb1080a99b0 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb0f7fff700 1 -- 172.21.15.31:0/1589044309 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f800d910 con 0x7fb1080a99b0 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb10f3d8700 1 -- 172.21.15.31:0/1589044309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1080a99b0 msgr2=0x7fb108063320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb10f3d8700 1 --2- 172.21.15.31:0/1589044309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1080a99b0 0x7fb108063320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fb0f8002f70 tx=0x7fb0f8006e50).stop 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb10f3d8700 1 -- 172.21.15.31:0/1589044309 shutdown_connections 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb10f3d8700 1 --2- 172.21.15.31:0/1589044309 >> v2:172.21.15.31:3300/0 conn(0x7fb108139c10 0x7fb108139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb10f3d8700 1 --2- 172.21.15.31:0/1589044309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1080a99b0 0x7fb108063320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb10f3d8700 1 -- 172.21.15.31:0/1589044309 >> 172.21.15.31:0/1589044309 conn(0x7fb108061350 msgr2=0x7fb10806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:12.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb10f3d8700 1 -- 172.21.15.31:0/1589044309 shutdown_connections 2024-04-26T07:28:12.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.331+0000 7fb10f3d8700 1 -- 172.21.15.31:0/1589044309 wait complete. 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.332+0000 7fb10f3d8700 1 Processor -- start 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.332+0000 7fb10f3d8700 1 -- start start 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10f3d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb10805b970 0x7fb108096390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10f3d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1080a99b0 0x7fb108094c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10f3d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb108139c10 0x7fb108145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10f3d8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb108095630 con 0x7fb1080a99b0 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10f3d8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080957a0 con 0x7fb10805b970 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10f3d8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb108093010 con 0x7fb108139c10 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10c973700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1080a99b0 0x7fb108094c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb10805b970 0x7fb108096390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb10805b970 0x7fb108096390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52212/0 (socket says 172.21.15.31:52212) 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 -- 172.21.15.31:0/3806351200 learned_addr learned my addr 172.21.15.31:0/3806351200 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d975700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb108139c10 0x7fb108145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 -- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb108139c10 msgr2=0x7fb108145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb108139c10 0x7fb108145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 -- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1080a99b0 msgr2=0x7fb108094c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1080a99b0 0x7fb108094c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 -- 172.21.15.31:0/3806351200 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10400b180 con 0x7fb10805b970 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10c973700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1080a99b0 0x7fb108094c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d975700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb108139c10 0x7fb108145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.333+0000 7fb10d174700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb10805b970 0x7fb108096390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb10400c000 tx=0x7fb104006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.334+0000 7fb0f67fc700 1 -- 172.21.15.31:0/3806351200 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb104010780 con 0x7fb10805b970 2024-04-26T07:28:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.334+0000 7fb0f67fc700 1 -- 172.21.15.31:0/3806351200 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1040108e0 con 0x7fb10805b970 2024-04-26T07:28:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.334+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f800b1e0 con 0x7fb10805b970 2024-04-26T07:28:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.334+0000 7fb0f67fc700 1 -- 172.21.15.31:0/3806351200 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb104010c40 con 0x7fb10805b970 2024-04-26T07:28:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.334+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10813d510 con 0x7fb10805b970 2024-04-26T07:28:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.334+0000 7fb0f67fc700 1 -- 172.21.15.31:0/3806351200 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fb10401c460 con 0x7fb10805b970 2024-04-26T07:28:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.334+0000 7fb0f67fc700 1 -- 172.21.15.31:0/3806351200 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb1040123f0 con 0x7fb10805b970 2024-04-26T07:28:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.335+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb108096af0 con 0x7fb10805b970 2024-04-26T07:28:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.337+0000 7fb0f67fc700 1 -- 172.21.15.31:0/3806351200 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fb1040125b0 con 0x7fb10805b970 2024-04-26T07:28:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.414+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "996fe73f-646a-43ac-8ab7-64432ddb26f9", "id": 0} v 0) v1 -- 0x7fb1080a9db0 con 0x7fb10805b970 2024-04-26T07:28:12.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.422+0000 7fb0f67fc700 1 -- 172.21.15.31:0/3806351200 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "996fe73f-646a-43ac-8ab7-64432ddb26f9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb104006020 con 0x7fb10805b970 2024-04-26T07:28:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:0 2024-04-26T07:28:12.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb10805b970 msgr2=0x7fb108096390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb10805b970 0x7fb108096390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb10400c000 tx=0x7fb104006df0).stop 2024-04-26T07:28:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 shutdown_connections 2024-04-26T07:28:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb108139c10 0x7fb108145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb10805b970 0x7fb108096390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 --2- 172.21.15.31:0/3806351200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1080a99b0 0x7fb108094c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 >> 172.21.15.31:0/3806351200 conn(0x7fb108061350 msgr2=0x7fb1081352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 shutdown_connections 2024-04-26T07:28:12.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.423+0000 7fb10f3d8700 1 -- 172.21.15.31:0/3806351200 wait complete. 2024-04-26T07:28:12.435 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 4733b11b-119d-4734-a403-5c68e528ee4f 1 2024-04-26T07:28:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.543+0000 7fee77c82700 1 Processor -- start 2024-04-26T07:28:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.544+0000 7fee77c82700 1 -- start start 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee77c82700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee70067c00 0x7fee700a0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee77c82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee700a3c60 0x7fee7013d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee77c82700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee700a1980 con 0x7fee700a3170 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee77c82700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7009fd90 con 0x7fee70067c00 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee77c82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700a1bd0 con 0x7fee700a3c60 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee7521d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee70067c00 0x7fee700a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee7621f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee700a3c60 0x7fee7013d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee75a1e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fee700a3170 0x7fee700a3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57058/0 (socket says 172.21.15.31:57058) 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee75a1e700 1 -- 172.21.15.31:0/800079818 learned_addr learned my addr 172.21.15.31:0/800079818 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee7621f700 1 -- 172.21.15.31:0/800079818 >> v2:172.21.15.31:3300/0 conn(0x7fee70067c00 msgr2=0x7fee700a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee7621f700 1 --2- 172.21.15.31:0/800079818 >> v2:172.21.15.31:3300/0 conn(0x7fee70067c00 0x7fee700a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee7621f700 1 -- 172.21.15.31:0/800079818 >> v1:172.21.15.31:6789/0 conn(0x7fee700a3170 legacy=0x7fee700a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee7621f700 1 -- 172.21.15.31:0/800079818 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700a5000 con 0x7fee700a3c60 2024-04-26T07:28:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee7621f700 1 --2- 172.21.15.31:0/800079818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee700a3c60 0x7fee7013d7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fee680032f0 tx=0x7fee680091d0).ready entity=mon.1 client_cookie=2d0fca839b328608 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.545+0000 7fee74a1c700 1 -- 172.21.15.31:0/800079818 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6800b6c0 con 0x7fee700a3c60 2024-04-26T07:28:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.546+0000 7fee74a1c700 1 -- 172.21.15.31:0/800079818 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6800b820 con 0x7fee700a3c60 2024-04-26T07:28:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.546+0000 7fee74a1c700 1 -- 172.21.15.31:0/800079818 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6800b990 con 0x7fee700a3c60 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.546+0000 7fee77c82700 1 -- 172.21.15.31:0/800079818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee700a3c60 msgr2=0x7fee7013d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.546+0000 7fee77c82700 1 --2- 172.21.15.31:0/800079818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee700a3c60 0x7fee7013d7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fee680032f0 tx=0x7fee680091d0).stop 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.546+0000 7fee77c82700 1 -- 172.21.15.31:0/800079818 shutdown_connections 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.546+0000 7fee77c82700 1 --2- 172.21.15.31:0/800079818 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee700a3c60 0x7fee7013d7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.546+0000 7fee77c82700 1 --2- 172.21.15.31:0/800079818 >> v2:172.21.15.31:3300/0 conn(0x7fee70067c00 0x7fee700a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.546+0000 7fee77c82700 1 -- 172.21.15.31:0/800079818 >> 172.21.15.31:0/800079818 conn(0x7fee700a9370 msgr2=0x7fee700a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.547+0000 7fee77c82700 1 -- 172.21.15.31:0/800079818 shutdown_connections 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.547+0000 7fee77c82700 1 -- 172.21.15.31:0/800079818 wait complete. 2024-04-26T07:28:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.548+0000 7fee77c82700 1 Processor -- start 2024-04-26T07:28:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.548+0000 7fee77c82700 1 -- start start 2024-04-26T07:28:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee77c82700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fee700a3170 0x7fee700622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee77c82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee700a3c60 0x7fee701326f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee77c82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee70132be0 0x7fee70147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee77c82700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee701330c0 con 0x7fee700a3c60 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee77c82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700627c0 con 0x7fee70132be0 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee77c82700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee70061af0 con 0x7fee700a3170 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee700a3c60 0x7fee701326f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee75a1e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fee700a3170 0x7fee700622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee700a3c60 0x7fee701326f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53592/0 (socket says 172.21.15.31:53592) 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 -- 172.21.15.31:0/274881373 learned_addr learned my addr 172.21.15.31:0/274881373 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7621f700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee70132be0 0x7fee70147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 -- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fee700a3170 msgr2=0x7fee700622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fee700a3170 0x7fee700622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 -- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee70132be0 msgr2=0x7fee70147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee70132be0 0x7fee70147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 -- 172.21.15.31:0/274881373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee68009470 con 0x7fee700a3c60 2024-04-26T07:28:12.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee75a1e700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fee700a3170 0x7fee700622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.549+0000 7fee7521d700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee700a3c60 0x7fee701326f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fee6000c000 tx=0x7fee60006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.550+0000 7fee5effd700 1 -- 172.21.15.31:0/274881373 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee60013b20 con 0x7fee700a3c60 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.550+0000 7fee5effd700 1 -- 172.21.15.31:0/274881373 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60013c80 con 0x7fee700a3c60 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.550+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee70130140 con 0x7fee700a3c60 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.550+0000 7fee5effd700 1 -- 172.21.15.31:0/274881373 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6001c420 con 0x7fee700a3c60 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.550+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee70133e50 con 0x7fee700a3c60 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.550+0000 7fee5effd700 1 -- 172.21.15.31:0/274881373 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fee60023070 con 0x7fee700a3c60 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.550+0000 7fee5effd700 1 -- 172.21.15.31:0/274881373 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fee6001b790 con 0x7fee700a3c60 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.551+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7006bbc0 con 0x7fee700a3c60 2024-04-26T07:28:12.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.553+0000 7fee5effd700 1 -- 172.21.15.31:0/274881373 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fee60021060 con 0x7fee700a3c60 2024-04-26T07:28:12.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.630+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4733b11b-119d-4734-a403-5c68e528ee4f", "id": 1} v 0) v1 -- 0x7fee70060010 con 0x7fee700a3c60 2024-04-26T07:28:12.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.635+0000 7fee5effd700 1 -- 172.21.15.31:0/274881373 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4733b11b-119d-4734-a403-5c68e528ee4f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee6001cbb0 con 0x7fee700a3c60 2024-04-26T07:28:12.636 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-04-26T07:28:12.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee700a3c60 msgr2=0x7fee701326f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee700a3c60 0x7fee701326f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fee6000c000 tx=0x7fee60006df0).stop 2024-04-26T07:28:12.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 shutdown_connections 2024-04-26T07:28:12.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fee700a3170 0x7fee700622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fee70132be0 0x7fee70147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 --2- 172.21.15.31:0/274881373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee700a3c60 0x7fee701326f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 >> 172.21.15.31:0/274881373 conn(0x7fee700a9370 msgr2=0x7fee700a80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:12.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 shutdown_connections 2024-04-26T07:28:12.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.636+0000 7fee77c82700 1 -- 172.21.15.31:0/274881373 wait complete. 2024-04-26T07:28:12.648 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new dc9a2269-10b7-40d5-bbd8-fc7f52d98adb 2 2024-04-26T07:28:12.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.753+0000 7fc87d12d700 1 Processor -- start 2024-04-26T07:28:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.753+0000 7fc87d12d700 1 -- start start 2024-04-26T07:28:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87d12d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc8781367f0 0x7fc878136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87d12d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc8781334c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87d12d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc8780a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87d12d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc878068440 con 0x7fc8781367f0 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87d12d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc878136370 con 0x7fc878064840 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87d12d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8781365d0 con 0x7fc8781339b0 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc8781334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc8781334c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52232/0 (socket says 172.21.15.31:52232) 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87659c700 1 -- 172.21.15.31:0/3469478187 learned_addr learned my addr 172.21.15.31:0/3469478187 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc876d9d700 1 --2- 172.21.15.31:0/3469478187 >> v2:172.21.15.31:3300/0 conn(0x7fc8781367f0 0x7fc878136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.754+0000 7fc87759e700 1 --2- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc8780a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc87759e700 1 -- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 msgr2=0x7fc8781334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc87759e700 1 --2- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc8781334c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc87759e700 1 -- 172.21.15.31:0/3469478187 >> v2:172.21.15.31:3300/0 conn(0x7fc8781367f0 msgr2=0x7fc878136bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc87759e700 1 --2- 172.21.15.31:0/3469478187 >> v2:172.21.15.31:3300/0 conn(0x7fc8781367f0 0x7fc878136bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc87759e700 1 -- 172.21.15.31:0/3469478187 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8781370c0 con 0x7fc8781339b0 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc87659c700 1 --2- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc8781334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:12.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc876d9d700 1 --2- 172.21.15.31:0/3469478187 >> v2:172.21.15.31:3300/0 conn(0x7fc8781367f0 0x7fc878136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc87759e700 1 --2- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc8780a81d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc8700032f0 tx=0x7fc87000b470).ready entity=mon.2 client_cookie=99d03cf705666db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc875d9b700 1 -- 172.21.15.31:0/3469478187 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc87000dca0 con 0x7fc8781339b0 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc875d9b700 1 -- 172.21.15.31:0/3469478187 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87000de00 con 0x7fc8781339b0 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.755+0000 7fc875d9b700 1 -- 172.21.15.31:0/3469478187 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc870010660 con 0x7fc8781339b0 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 -- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 msgr2=0x7fc8780a81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 --2- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc8780a81d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc8700032f0 tx=0x7fc87000b470).stop 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 -- 172.21.15.31:0/3469478187 shutdown_connections 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 --2- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc8780a81d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 --2- 172.21.15.31:0/3469478187 >> v2:172.21.15.31:3300/0 conn(0x7fc8781367f0 0x7fc878136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 --2- 172.21.15.31:0/3469478187 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc8781334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 -- 172.21.15.31:0/3469478187 >> 172.21.15.31:0/3469478187 conn(0x7fc878061350 msgr2=0x7fc87806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:12.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 -- 172.21.15.31:0/3469478187 shutdown_connections 2024-04-26T07:28:12.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.756+0000 7fc87d12d700 1 -- 172.21.15.31:0/3469478187 wait complete. 2024-04-26T07:28:12.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc87d12d700 1 Processor -- start 2024-04-26T07:28:12.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc87d12d700 1 -- start start 2024-04-26T07:28:12.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc87d12d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc878097480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc87d12d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc878145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc87d12d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8781367f0 0x7fc8781461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc87d12d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878067be0 con 0x7fc8781367f0 2024-04-26T07:28:12.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc87d12d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc878098a00 con 0x7fc878064840 2024-04-26T07:28:12.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc87d12d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc878145a40 con 0x7fc8781339b0 2024-04-26T07:28:12.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.757+0000 7fc876d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc878097480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc876d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc878097480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52240/0 (socket says 172.21.15.31:52240) 2024-04-26T07:28:12.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc876d9d700 1 -- 172.21.15.31:0/2201420277 learned_addr learned my addr 172.21.15.31:0/2201420277 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:12.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc87659c700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc878145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc87759e700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8781367f0 0x7fc8781461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc876d9d700 1 -- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 msgr2=0x7fc878145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc876d9d700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc878145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc876d9d700 1 -- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8781367f0 msgr2=0x7fc8781461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc876d9d700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8781367f0 0x7fc8781461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc876d9d700 1 -- 172.21.15.31:0/2201420277 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c00b1e0 con 0x7fc878064840 2024-04-26T07:28:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc87659c700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc878145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc876d9d700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc878097480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc86800c000 tx=0x7fc868006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc867fff700 1 -- 172.21.15.31:0/2201420277 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc868010590 con 0x7fc878064840 2024-04-26T07:28:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc867fff700 1 -- 172.21.15.31:0/2201420277 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8680106f0 con 0x7fc878064840 2024-04-26T07:28:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86800b180 con 0x7fc878064840 2024-04-26T07:28:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc867fff700 1 -- 172.21.15.31:0/2201420277 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc868010a50 con 0x7fc878064840 2024-04-26T07:28:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87000b710 con 0x7fc878064840 2024-04-26T07:28:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc867fff700 1 -- 172.21.15.31:0/2201420277 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fc86801c460 con 0x7fc878064840 2024-04-26T07:28:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.758+0000 7fc867fff700 1 -- 172.21.15.31:0/2201420277 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fc868010d80 con 0x7fc878064840 2024-04-26T07:28:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.759+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc878061fe0 con 0x7fc878064840 2024-04-26T07:28:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.761+0000 7fc867fff700 1 -- 172.21.15.31:0/2201420277 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fc86801cba0 con 0x7fc878064840 2024-04-26T07:28:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.837+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dc9a2269-10b7-40d5-bbd8-fc7f52d98adb", "id": 2} v 0) v1 -- 0x7fc87806bbc0 con 0x7fc878064840 2024-04-26T07:28:12.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.846+0000 7fc867fff700 1 -- 172.21.15.31:0/2201420277 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc9a2269-10b7-40d5-bbd8-fc7f52d98adb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc86801ce00 con 0x7fc878064840 2024-04-26T07:28:12.848 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-04-26T07:28:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.847+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 msgr2=0x7fc878097480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.847+0000 7fc87d12d700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc878097480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc86800c000 tx=0x7fc868006df0).stop 2024-04-26T07:28:12.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.847+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 shutdown_connections 2024-04-26T07:28:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.847+0000 7fc87d12d700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8781367f0 0x7fc8781461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.847+0000 7fc87d12d700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc878064840 0x7fc878097480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.847+0000 7fc87d12d700 1 --2- 172.21.15.31:0/2201420277 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8781339b0 0x7fc878145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.847+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 >> 172.21.15.31:0/2201420277 conn(0x7fc878061350 msgr2=0x7fc87805c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.848+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 shutdown_connections 2024-04-26T07:28:12.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.848+0000 7fc87d12d700 1 -- 172.21.15.31:0/2201420277 wait complete. 2024-04-26T07:28:12.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new a2b8d011-c9aa-4c78-8f70-feff7e8c8c10 3 2024-04-26T07:28:12.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.966+0000 7f4ee59b4700 1 Processor -- start 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.966+0000 7f4ee59b4700 1 -- start start 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4ee59b4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ee006c990 0x7f4ee0137c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4ee59b4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee0134960 0x7f4ee013e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4ee59b4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee006cd70 con 0x7f4ee01373d0 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4ee59b4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee0133e00 con 0x7f4ee006c990 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4ee59b4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00630f0 con 0x7f4ee0134960 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4edf7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee0134960 0x7f4ee013e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4edeffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ee006c990 0x7f4ee0137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4edf7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee0134960 0x7f4ee013e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52502/0 (socket says 172.21.15.31:52502) 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4edf7fe700 1 -- 172.21.15.31:0/2051950068 learned_addr learned my addr 172.21.15.31:0/2051950068 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4edf7fe700 1 -- 172.21.15.31:0/2051950068 >> v2:172.21.15.31:3300/0 conn(0x7f4ee006c990 msgr2=0x7f4ee0137c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4edf7fe700 1 --2- 172.21.15.31:0/2051950068 >> v2:172.21.15.31:3300/0 conn(0x7f4ee006c990 0x7f4ee0137c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4edf7fe700 1 -- 172.21.15.31:0/2051950068 >> v1:172.21.15.31:6789/0 conn(0x7f4ee01373d0 legacy=0x7f4ee0134250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.967+0000 7f4edf7fe700 1 -- 172.21.15.31:0/2051950068 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0133ff0 con 0x7f4ee0134960 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.968+0000 7f4edf7fe700 1 --2- 172.21.15.31:0/2051950068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee0134960 0x7f4ee013e770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4ee00652d0 tx=0x7f4ed8009290).ready entity=mon.2 client_cookie=f3215bc2d99d1ae5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.968+0000 7f4eddffb700 1 -- 172.21.15.31:0/2051950068 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed800b860 con 0x7f4ee0134960 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.968+0000 7f4eddffb700 1 -- 172.21.15.31:0/2051950068 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800b9c0 con 0x7f4ee0134960 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.968+0000 7f4eddffb700 1 -- 172.21.15.31:0/2051950068 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed800bb30 con 0x7f4ee0134960 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.968+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2051950068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee0134960 msgr2=0x7f4ee013e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.968+0000 7f4ee59b4700 1 --2- 172.21.15.31:0/2051950068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee0134960 0x7f4ee013e770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4ee00652d0 tx=0x7f4ed8009290).stop 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.969+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2051950068 shutdown_connections 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.969+0000 7f4ee59b4700 1 --2- 172.21.15.31:0/2051950068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee0134960 0x7f4ee013e770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.969+0000 7f4ee59b4700 1 --2- 172.21.15.31:0/2051950068 >> v2:172.21.15.31:3300/0 conn(0x7f4ee006c990 0x7f4ee0137c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.969+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2051950068 >> 172.21.15.31:0/2051950068 conn(0x7f4ee0062460 msgr2=0x7f4ee006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.969+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2051950068 shutdown_connections 2024-04-26T07:28:12.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.969+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2051950068 wait complete. 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ee59b4700 1 Processor -- start 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ee59b4700 1 -- start start 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ee59b4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee006c990 0x7f4ee00943e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ee59b4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ee0134960 0x7f4ee0130db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ee59b4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee01373d0 0x7f4ee01312a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ee59b4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0094ea0 con 0x7f4ee006c990 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ee59b4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0095180 con 0x7f4ee0134960 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ee59b4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0094a00 con 0x7f4ee01373d0 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ede7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ee0134960 0x7f4ee0130db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4edf7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee01373d0 0x7f4ee01312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ede7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ee0134960 0x7f4ee0130db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52244/0 (socket says 172.21.15.31:52244) 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4ede7fc700 1 -- 172.21.15.31:0/2083108721 learned_addr learned my addr 172.21.15.31:0/2083108721 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.970+0000 7f4edeffd700 1 --2- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee006c990 0x7f4ee00943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:12.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4edf7fe700 1 -- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ee0134960 msgr2=0x7f4ee0130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4edf7fe700 1 --2- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ee0134960 0x7f4ee0130db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4edf7fe700 1 -- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee006c990 msgr2=0x7f4ee00943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4edf7fe700 1 --2- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee006c990 0x7f4ee00943e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4edf7fe700 1 -- 172.21.15.31:0/2083108721 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009530 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4edf7fe700 1 --2- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee01373d0 0x7f4ee01312a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4ee00652d0 tx=0x7f4ed8016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4ecffff700 1 -- 172.21.15.31:0/2083108721 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed80032f0 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4ecffff700 1 -- 172.21.15.31:0/2083108721 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8021440 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4ecffff700 1 -- 172.21.15.31:0/2083108721 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed80217a0 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee0095820 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee0131790 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4ecffff700 1 -- 172.21.15.31:0/2083108721 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4ed8028070 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.971+0000 7f4ecffff700 1 -- 172.21.15.31:0/2083108721 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f4ed8021ce0 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.972+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee0093070 con 0x7f4ee01373d0 2024-04-26T07:28:12.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:12.975+0000 7f4ecffff700 1 -- 172.21.15.31:0/2083108721 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4ed8026060 con 0x7f4ee01373d0 2024-04-26T07:28:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.051+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd new", "uuid": "a2b8d011-c9aa-4c78-8f70-feff7e8c8c10", "id": 3} v 0) v1 -- 0x7f4ee006bbc0 con 0x7f4ee01373d0 2024-04-26T07:28:13.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.054+0000 7f4ecffff700 1 -- 172.21.15.31:0/2083108721 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2b8d011-c9aa-4c78-8f70-feff7e8c8c10", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ed8015020 con 0x7f4ee01373d0 2024-04-26T07:28:13.055 INFO:teuthology.orchestra.run.smithi031.stdout:3 2024-04-26T07:28:13.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee01373d0 msgr2=0x7f4ee01312a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 --2- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee01373d0 0x7f4ee01312a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4ee00652d0 tx=0x7f4ed8016000).stop 2024-04-26T07:28:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 shutdown_connections 2024-04-26T07:28:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 --2- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ee01373d0 0x7f4ee01312a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 --2- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ee006c990 0x7f4ee00943e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 --2- 172.21.15.31:0/2083108721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ee0134960 0x7f4ee0130db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 >> 172.21.15.31:0/2083108721 conn(0x7f4ee0062460 msgr2=0x7f4ee0063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 shutdown_connections 2024-04-26T07:28:13.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.055+0000 7f4ee59b4700 1 -- 172.21.15.31:0/2083108721 wait complete. 2024-04-26T07:28:13.067 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T07:28:13.067 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T07:28:13.069 INFO:tasks.ceph.osd.0:Started 2024-04-26T07:28:13.069 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T07:28:13.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T07:28:13.071 INFO:tasks.ceph.osd.1:Started 2024-04-26T07:28:13.072 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T07:28:13.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T07:28:13.073 INFO:tasks.ceph.osd.2:Started 2024-04-26T07:28:13.074 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T07:28:13.074 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T07:28:13.076 INFO:tasks.ceph.osd.3:Started 2024-04-26T07:28:13.076 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.235+0000 7ff53a1cc700 1 Processor -- start 2024-04-26T07:28:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff53a1cc700 1 -- start start 2024-04-26T07:28:13.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff53a1cc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff5340679d0 0x7ff5341339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff53a1cc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff534140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff53a1cc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff534133ea0 con 0x7ff5341335d0 2024-04-26T07:28:13.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff53a1cc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340670c0 con 0x7ff5340679d0 2024-04-26T07:28:13.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff53a1cc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff534066600 con 0x7ff53413ea20 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff533fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff534140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff533fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff534140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52308/0 (socket says 172.21.15.31:52308) 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff533fff700 1 -- 172.21.15.31:0/3731540562 learned_addr learned my addr 172.21.15.31:0/3731540562 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.236+0000 7ff532ffd700 1 --2- 172.21.15.31:0/3731540562 >> v2:172.21.15.31:3300/0 conn(0x7ff5340679d0 0x7ff5341339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff533fff700 1 -- 172.21.15.31:0/3731540562 >> v2:172.21.15.31:3300/0 conn(0x7ff5340679d0 msgr2=0x7ff5341339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff533fff700 1 --2- 172.21.15.31:0/3731540562 >> v2:172.21.15.31:3300/0 conn(0x7ff5340679d0 0x7ff5341339b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff533fff700 1 -- 172.21.15.31:0/3731540562 >> v1:172.21.15.31:6789/0 conn(0x7ff5341335d0 legacy=0x7ff5340a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff533fff700 1 -- 172.21.15.31:0/3731540562 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534066de0 con 0x7ff53413ea20 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff532ffd700 1 --2- 172.21.15.31:0/3731540562 >> v2:172.21.15.31:3300/0 conn(0x7ff5340679d0 0x7ff5341339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff533fff700 1 --2- 172.21.15.31:0/3731540562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff534140e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff52c0032f0 tx=0x7ff52c009290).ready entity=mon.1 client_cookie=a8eab77cefc0bb97 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff5327fc700 1 -- 172.21.15.31:0/3731540562 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff52c00b8a0 con 0x7ff53413ea20 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff5327fc700 1 -- 172.21.15.31:0/3731540562 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c00ba00 con 0x7ff53413ea20 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.237+0000 7ff5327fc700 1 -- 172.21.15.31:0/3731540562 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff52c00bb70 con 0x7ff53413ea20 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.238+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3731540562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 msgr2=0x7ff534140e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.238+0000 7ff53a1cc700 1 --2- 172.21.15.31:0/3731540562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff534140e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff52c0032f0 tx=0x7ff52c009290).stop 2024-04-26T07:28:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.238+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3731540562 shutdown_connections 2024-04-26T07:28:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.238+0000 7ff53a1cc700 1 --2- 172.21.15.31:0/3731540562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff534140e10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.238+0000 7ff53a1cc700 1 --2- 172.21.15.31:0/3731540562 >> v2:172.21.15.31:3300/0 conn(0x7ff5340679d0 0x7ff5341339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.238+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3731540562 >> 172.21.15.31:0/3731540562 conn(0x7ff534060ee0 msgr2=0x7ff5340a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.238+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3731540562 shutdown_connections 2024-04-26T07:28:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.238+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3731540562 wait complete. 2024-04-26T07:28:13.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.239+0000 7ff53a1cc700 1 Processor -- start 2024-04-26T07:28:13.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.240+0000 7ff53a1cc700 1 -- start start 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff53a1cc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5340679d0 0x7ff5340a2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff53a1cc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5341335d0 0x7ff53412c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff53a1cc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff53412c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff53a1cc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534134550 con 0x7ff5341335d0 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff53a1cc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff534134990 con 0x7ff53413ea20 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff53a1cc700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340a2690 con 0x7ff5340679d0 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff5337fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5340679d0 0x7ff5340a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff53412c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff53412c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52320/0 (socket says 172.21.15.31:52320) 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff5337fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5340679d0 0x7ff5340a2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52546/0 (socket says 172.21.15.31:52546) 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 -- 172.21.15.31:0/3364208155 learned_addr learned my addr 172.21.15.31:0/3364208155 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff532ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5341335d0 0x7ff53412c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 -- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5340679d0 msgr2=0x7ff5340a2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 --2- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5340679d0 0x7ff5340a2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 -- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5341335d0 msgr2=0x7ff53412c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 --2- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5341335d0 0x7ff53412c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 -- 172.21.15.31:0/3364208155 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52800b180 con 0x7ff53413ea20 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff532ffd700 1 --2- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5341335d0 0x7ff53412c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.241+0000 7ff533fff700 1 --2- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff53412c520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff534134690 tx=0x7ff52c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.242+0000 7ff530ff9700 1 -- 172.21.15.31:0/3364208155 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff52c00b8a0 con 0x7ff53413ea20 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.242+0000 7ff530ff9700 1 -- 172.21.15.31:0/3364208155 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c021440 con 0x7ff53413ea20 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.242+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c009530 con 0x7ff53413ea20 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.242+0000 7ff530ff9700 1 -- 172.21.15.31:0/3364208155 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff52c006b60 con 0x7ff53413ea20 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.242+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff534135170 con 0x7ff53413ea20 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.242+0000 7ff530ff9700 1 -- 172.21.15.31:0/3364208155 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7ff52c027020 con 0x7ff53413ea20 2024-04-26T07:28:13.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.242+0000 7ff530ff9700 1 -- 172.21.15.31:0/3364208155 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7ff52c021b80 con 0x7ff53413ea20 2024-04-26T07:28:13.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.243+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff534067e60 con 0x7ff53413ea20 2024-04-26T07:28:13.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.245+0000 7ff530ff9700 1 -- 172.21.15.31:0/3364208155 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff52c015020 con 0x7ff53413ea20 2024-04-26T07:28:13.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.309+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff53406bbc0 con 0x7ff53413ea20 2024-04-26T07:28:13.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.309+0000 7ff530ff9700 1 -- 172.21.15.31:0/3364208155 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7ff52c006dc0 con 0x7ff53413ea20 2024-04-26T07:28:13.311 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:13.311 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:13.053761+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.310+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 msgr2=0x7ff53412c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.310+0000 7ff53a1cc700 1 --2- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff53412c520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff534134690 tx=0x7ff52c016000).stop 2024-04-26T07:28:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.310+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 shutdown_connections 2024-04-26T07:28:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.310+0000 7ff53a1cc700 1 --2- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5340679d0 0x7ff5340a2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.310+0000 7ff53a1cc700 1 --2- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff53413ea20 0x7ff53412c520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.310+0000 7ff53a1cc700 1 --2- 172.21.15.31:0/3364208155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5341335d0 0x7ff53412c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.310+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 >> 172.21.15.31:0/3364208155 conn(0x7ff534060ee0 msgr2=0x7ff5340a52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.311+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 shutdown_connections 2024-04-26T07:28:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:13.311+0000 7ff53a1cc700 1 -- 172.21.15.31:0/3364208155 wait complete. 2024-04-26T07:28:13.323 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T07:28:13.323 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T07:28:13.455 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-26T07:28:13.454+0000 7f735da87f00 -1 Falling back to public interface 2024-04-26T07:28:13.462 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-26T07:28:13.461+0000 7f4c1a3c9f00 -1 Falling back to public interface 2024-04-26T07:28:13.705 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-26T07:28:13.704+0000 7f93fd5f8f00 -1 Falling back to public interface 2024-04-26T07:28:13.716 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-26T07:28:13.715+0000 7fdf7c143f00 -1 Falling back to public interface 2024-04-26T07:28:13.727 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:13.843 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.842+0000 7fafb2bdd700 1 Processor -- start 2024-04-26T07:28:13.844 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.842+0000 7fafb2bdd700 1 -- start start 2024-04-26T07:28:13.844 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafb2bdd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac0a1fc0 0x7fafac0a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.844 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafb2bdd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac13b590 0x7fafac13d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.844 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafb2bdd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0a1250 con 0x7fafac133410 2024-04-26T07:28:13.844 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafb2bdd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac133f00 con 0x7fafac0a1fc0 2024-04-26T07:28:13.845 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafb2bdd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0a2470 con 0x7fafac13b590 2024-04-26T07:28:13.845 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafabfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac0a1fc0 0x7fafac0a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.845 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafabfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac0a1fc0 0x7fafac0a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52332/0 (socket says 172.21.15.31:52332) 2024-04-26T07:28:13.845 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafabfff700 1 -- 172.21.15.31:0/3589327960 learned_addr learned my addr 172.21.15.31:0/3589327960 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:13.845 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.843+0000 7fafb117a700 1 --2- 172.21.15.31:0/3589327960 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac13b590 0x7fafac13d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.846 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.844+0000 7fafb117a700 1 -- 172.21.15.31:0/3589327960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac0a1fc0 msgr2=0x7fafac0a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:13.846 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.844+0000 7fafb117a700 1 --2- 172.21.15.31:0/3589327960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac0a1fc0 0x7fafac0a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.846 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.844+0000 7fafb117a700 1 -- 172.21.15.31:0/3589327960 >> v1:172.21.15.31:6789/0 conn(0x7fafac133410 legacy=0x7fafac1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:13.846 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.844+0000 7fafb117a700 1 -- 172.21.15.31:0/3589327960 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0a2710 con 0x7fafac13b590 2024-04-26T07:28:13.846 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.844+0000 7fafb117a700 1 --2- 172.21.15.31:0/3589327960 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac13b590 0x7fafac13d980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fafac0a6030 tx=0x7fafa40091d0).ready entity=mon.2 client_cookie=277c78fb1be4155b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:13.846 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.844+0000 7fafab7fe700 1 -- 172.21.15.31:0/3589327960 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafa400b670 con 0x7fafac13b590 2024-04-26T07:28:13.846 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.844+0000 7fafab7fe700 1 -- 172.21.15.31:0/3589327960 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400b7d0 con 0x7fafac13b590 2024-04-26T07:28:13.846 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.844+0000 7fafab7fe700 1 -- 172.21.15.31:0/3589327960 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafa400b980 con 0x7fafac13b590 2024-04-26T07:28:13.847 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.845+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3589327960 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac13b590 msgr2=0x7fafac13d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.847 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.845+0000 7fafb2bdd700 1 --2- 172.21.15.31:0/3589327960 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac13b590 0x7fafac13d980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fafac0a6030 tx=0x7fafa40091d0).stop 2024-04-26T07:28:13.847 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.845+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3589327960 shutdown_connections 2024-04-26T07:28:13.847 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.845+0000 7fafb2bdd700 1 --2- 172.21.15.31:0/3589327960 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac13b590 0x7fafac13d980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.847 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.845+0000 7fafb2bdd700 1 --2- 172.21.15.31:0/3589327960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac0a1fc0 0x7fafac0a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.847 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.845+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3589327960 >> 172.21.15.31:0/3589327960 conn(0x7fafac0a5300 msgr2=0x7fafac0a5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:13.847 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.845+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3589327960 shutdown_connections 2024-04-26T07:28:13.847 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.845+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3589327960 wait complete. 2024-04-26T07:28:13.848 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.846+0000 7fafb2bdd700 1 Processor -- start 2024-04-26T07:28:13.848 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.847+0000 7fafb2bdd700 1 -- start start 2024-04-26T07:28:13.849 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.847+0000 7fafb2bdd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafac0a1fc0 0x7fafac062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.849 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.847+0000 7fafb2bdd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac133410 0x7fafac061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.849 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.847+0000 7fafb2bdd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac13b590 0x7fafac138500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:13.849 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.847+0000 7fafb2bdd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0630d0 con 0x7fafac0a1fc0 2024-04-26T07:28:13.850 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.847+0000 7fafb2bdd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac13ad00 con 0x7fafac13b590 2024-04-26T07:28:13.850 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.847+0000 7fafb2bdd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafac13afa0 con 0x7fafac133410 2024-04-26T07:28:13.850 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb117a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac13b590 0x7fafac138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.850 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb117a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac13b590 0x7fafac138500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:52340/0 (socket says 172.21.15.31:52340) 2024-04-26T07:28:13.850 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb117a700 1 -- 172.21.15.31:0/3462124767 learned_addr learned my addr 172.21.15.31:0/3462124767 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:13.850 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafabfff700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac133410 0x7fafac061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.850 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb0979700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafac0a1fc0 0x7fafac062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:13.851 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb117a700 1 -- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac133410 msgr2=0x7fafac061830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.851 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb117a700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac133410 0x7fafac061830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.852 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb117a700 1 -- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafac0a1fc0 msgr2=0x7fafac062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.852 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb117a700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafac0a1fc0 0x7fafac062be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.852 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.848+0000 7fafb117a700 1 -- 172.21.15.31:0/3462124767 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009470 con 0x7fafac13b590 2024-04-26T07:28:13.852 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.849+0000 7fafb117a700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac13b590 0x7fafac138500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fafac0a6030 tx=0x7fafa4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:13.852 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.849+0000 7fafa9ffb700 1 -- 172.21.15.31:0/3462124767 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafa4020600 con 0x7fafac13b590 2024-04-26T07:28:13.852 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.849+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac062140 con 0x7fafac13b590 2024-04-26T07:28:13.852 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.849+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac13a9c0 con 0x7fafac13b590 2024-04-26T07:28:13.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.849+0000 7fafa9ffb700 1 -- 172.21.15.31:0/3462124767 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4024070 con 0x7fafac13b590 2024-04-26T07:28:13.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.849+0000 7fafa9ffb700 1 -- 172.21.15.31:0/3462124767 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafa4020950 con 0x7fafac13b590 2024-04-26T07:28:13.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.850+0000 7fafa9ffb700 1 -- 172.21.15.31:0/3462124767 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fafa400f070 con 0x7fafac13b590 2024-04-26T07:28:13.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.850+0000 7fafa9ffb700 1 -- 172.21.15.31:0/3462124767 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fafa40108b0 con 0x7fafac13b590 2024-04-26T07:28:13.853 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.850+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf84003410 con 0x7fafac13b590 2024-04-26T07:28:13.855 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.854+0000 7fafa9ffb700 1 -- 172.21.15.31:0/3462124767 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fafa401b030 con 0x7fafac13b590 2024-04-26T07:28:13.920 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.919+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf840036c0 con 0x7fafac13b590 2024-04-26T07:28:13.920 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.919+0000 7fafa9ffb700 1 -- 172.21.15.31:0/3462124767 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7fafa4036090 con 0x7fafac13b590 2024-04-26T07:28:13.921 INFO:teuthology.misc.health.smithi031.stdout: 2024-04-26T07:28:13.921 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":6,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:13.053761+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:13.922 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.920+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac13b590 msgr2=0x7fafac138500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:13.922 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.920+0000 7fafb2bdd700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac13b590 0x7fafac138500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fafac0a6030 tx=0x7fafa4016000).stop 2024-04-26T07:28:13.922 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.920+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 shutdown_connections 2024-04-26T07:28:13.922 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.920+0000 7fafb2bdd700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fafac13b590 0x7fafac138500 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.922 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.920+0000 7fafb2bdd700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafac0a1fc0 0x7fafac062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.922 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.920+0000 7fafb2bdd700 1 --2- 172.21.15.31:0/3462124767 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fafac133410 0x7fafac061830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:13.922 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.920+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 >> 172.21.15.31:0/3462124767 conn(0x7fafac0a5300 msgr2=0x7fafac0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:13.922 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.921+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 shutdown_connections 2024-04-26T07:28:13.926 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:13.926+0000 7fafb2bdd700 1 -- 172.21.15.31:0/3462124767 wait complete. 2024-04-26T07:28:13.936 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-26T07:28:14.550 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-26T07:28:14.549+0000 7f735da87f00 -1 osd.0 0 log_to_monitors {default=true} 2024-04-26T07:28:14.771 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-26T07:28:14.770+0000 7f93fd5f8f00 -1 osd.1 0 log_to_monitors {default=true} 2024-04-26T07:28:14.791 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-26T07:28:14.790+0000 7f4c1a3c9f00 -1 osd.3 0 log_to_monitors {default=true} 2024-04-26T07:28:14.807 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-26T07:28:14.806+0000 7fdf7c143f00 -1 osd.2 0 log_to_monitors {default=true} 2024-04-26T07:28:15.985 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-26T07:28:15.984+0000 7f93e5ac3700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T07:28:15.985 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-26T07:28:15.985+0000 7fdf6460e700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T07:28:15.987 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-26T07:28:15.986+0000 7f4c02894700 -1 osd.3 0 waiting for initial osdmap 2024-04-26T07:28:15.987 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-26T07:28:15.986+0000 7f7345f52700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T07:28:15.996 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-26T07:28:15.995+0000 7f4c0e2b1700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:28:15.996 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-26T07:28:15.995+0000 7fdf7002b700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:28:15.999 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-26T07:28:15.998+0000 7f735196f700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:28:15.999 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-26T07:28:15.998+0000 7f93f14e0700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:28:20.340 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:20.451 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.450+0000 7f026f3e5700 1 Processor -- start 2024-04-26T07:28:20.451 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.450+0000 7f026f3e5700 1 -- start start 2024-04-26T07:28:20.452 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026f3e5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268061af0 0x7f02680aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.452 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026f3e5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268139e60 0x7f02681409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026f3e5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026806cd70 con 0x7f026806c990 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026f3e5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0268060840 con 0x7f0268061af0 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026f3e5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02680aaea0 con 0x7f0268139e60 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026c980700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268061af0 0x7f02680aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026d982700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268139e60 0x7f02681409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026d181700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f026806c990 0x7f0268061060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34826/0 (socket says 172.21.15.31:34826) 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026d181700 1 -- 172.21.15.31:0/2093713918 learned_addr learned my addr 172.21.15.31:0/2093713918 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026d982700 1 -- 172.21.15.31:0/2093713918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268061af0 msgr2=0x7f02680aa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f0257fff700 1 -- 172.21.15.31:0/2093713918 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235099145 0 0) 0x7f026806cd70 con 0x7f026806c990 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026d982700 1 --2- 172.21.15.31:0/2093713918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268061af0 0x7f02680aa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026d982700 1 -- 172.21.15.31:0/2093713918 >> v1:172.21.15.31:6789/0 conn(0x7f026806c990 legacy=0x7f0268061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026d982700 1 -- 172.21.15.31:0/2093713918 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268139790 con 0x7f0268139e60 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026c980700 1 --2- 172.21.15.31:0/2093713918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268061af0 0x7f02680aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:20.453 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f026d982700 1 --2- 172.21.15.31:0/2093713918 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268139e60 0x7f02681409b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f02600032f0 tx=0x7f02600091d0).ready entity=mon.2 client_cookie=bb0cc3ce99e653e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:20.454 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f0257fff700 1 -- 172.21.15.31:0/2093713918 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f026000b660 con 0x7f0268139e60 2024-04-26T07:28:20.454 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f0257fff700 1 -- 172.21.15.31:0/2093713918 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000b7c0 con 0x7f0268139e60 2024-04-26T07:28:20.454 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.451+0000 7f0257fff700 1 -- 172.21.15.31:0/2093713918 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f026000b930 con 0x7f0268139e60 2024-04-26T07:28:20.457 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.452+0000 7f026f3e5700 1 -- 172.21.15.31:0/2093713918 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268139e60 msgr2=0x7f02681409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.457 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.452+0000 7f026f3e5700 1 --2- 172.21.15.31:0/2093713918 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268139e60 0x7f02681409b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f02600032f0 tx=0x7f02600091d0).stop 2024-04-26T07:28:20.457 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.452+0000 7f026f3e5700 1 -- 172.21.15.31:0/2093713918 shutdown_connections 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.452+0000 7f026f3e5700 1 --2- 172.21.15.31:0/2093713918 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268139e60 0x7f02681409b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.452+0000 7f026f3e5700 1 --2- 172.21.15.31:0/2093713918 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268061af0 0x7f02680aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.452+0000 7f026f3e5700 1 -- 172.21.15.31:0/2093713918 >> 172.21.15.31:0/2093713918 conn(0x7f02680623f0 msgr2=0x7f026806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.452+0000 7f026f3e5700 1 -- 172.21.15.31:0/2093713918 shutdown_connections 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.452+0000 7f026f3e5700 1 -- 172.21.15.31:0/2093713918 wait complete. 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.453+0000 7f026f3e5700 1 Processor -- start 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.453+0000 7f026f3e5700 1 -- start start 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026f3e5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268061af0 0x7f0268092440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026f3e5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f026806c990 0x7f0268145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026f3e5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268139e60 0x7f02680931e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026f3e5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268145aa0 con 0x7f026806c990 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026f3e5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0268094410 con 0x7f0268139e60 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026f3e5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0268094610 con 0x7f0268061af0 2024-04-26T07:28:20.458 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268061af0 0x7f0268092440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026c980700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f026806c990 0x7f0268145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268061af0 0x7f0268092440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:33522/0 (socket says 172.21.15.31:33522) 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 -- 172.21.15.31:0/3924881946 learned_addr learned my addr 172.21.15.31:0/3924881946 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d982700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268139e60 0x7f02680931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 -- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268139e60 msgr2=0x7f02680931e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268139e60 0x7f02680931e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 -- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f026806c990 msgr2=0x7f0268145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f026806c990 0x7f0268145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 -- 172.21.15.31:0/3924881946 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025800b180 con 0x7f0268061af0 2024-04-26T07:28:20.459 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026c980700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f026806c990 0x7f0268145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026d181700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268061af0 0x7f0268092440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f02680923c0 tx=0x7f0264007a60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f02567fc700 1 -- 172.21.15.31:0/3924881946 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02640070d0 con 0x7f0268061af0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f02567fc700 1 -- 172.21.15.31:0/3924881946 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0264007230 con 0x7f0268061af0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0260009470 con 0x7f0268061af0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.454+0000 7f02567fc700 1 -- 172.21.15.31:0/3924881946 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0264005610 con 0x7f0268061af0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.455+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268136dd0 con 0x7f0268061af0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.455+0000 7f02567fc700 1 -- 172.21.15.31:0/3924881946 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0264010070 con 0x7f0268061af0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.456+0000 7f02567fc700 1 -- 172.21.15.31:0/3924881946 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2469+0+0 (secure 0 0 0) 0x7f0264049a90 con 0x7f0268061af0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.456+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0268139a30 con 0x7f0268061af0 2024-04-26T07:28:20.460 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.459+0000 7f02567fc700 1 -- 172.21.15.31:0/3924881946 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f026402ee40 con 0x7f0268061af0 2024-04-26T07:28:20.578 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.577+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0268095070 con 0x7f0268061af0 2024-04-26T07:28:20.579 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.578+0000 7f02567fc700 1 -- 172.21.15.31:0/3924881946 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6237 (secure 0 0 0) 0x7f0264032460 con 0x7f0268061af0 2024-04-26T07:28:20.579 INFO:teuthology.misc.health.smithi031.stdout: 2024-04-26T07:28:20.580 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":11,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:18.998964+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 >> v1:172.21.15.31:6816/39613 conn(0x7f0248038da0 legacy=0x7f024803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268061af0 msgr2=0x7f0268092440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268061af0 0x7f0268092440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f02680923c0 tx=0x7f0264007a60).stop 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 shutdown_connections 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0268061af0 0x7f0268092440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0268139e60 0x7f02680931e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 --2- 172.21.15.31:0/3924881946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f026806c990 0x7f0268145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 >> 172.21.15.31:0/3924881946 conn(0x7f02680623f0 msgr2=0x7f02680a82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 shutdown_connections 2024-04-26T07:28:20.581 INFO:teuthology.misc.health.smithi031.stderr:2024-04-26T07:28:20.579+0000 7f026f3e5700 1 -- 172.21.15.31:0/3924881946 wait complete. 2024-04-26T07:28:20.590 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-26T07:28:20.590 INFO:tasks.ceph:Creating RBD pool 2024-04-26T07:28:20.590 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T07:28:20.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.695+0000 7f3e87f58700 1 Processor -- start 2024-04-26T07:28:20.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.695+0000 7f3e87f58700 1 -- start start 2024-04-26T07:28:20.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e87f58700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e80067d70 0x7f3e80066e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e87f58700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e8005dfb0 0x7f3e8005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e87f58700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005be60 0x7f3e8005c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e87f58700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8005c800 con 0x7f3e8005dfb0 2024-04-26T07:28:20.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e87f58700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80066600 con 0x7f3e80067d70 2024-04-26T07:28:20.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e87f58700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800a4730 con 0x7f3e8005be60 2024-04-26T07:28:20.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e864f5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005be60 0x7f3e8005c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e85cf4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e80067d70 0x7f3e80066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e854f3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e8005dfb0 0x7f3e8005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e85cf4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e80067d70 0x7f3e80066e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:45078/0 (socket says 172.21.15.31:45078) 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e864f5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005be60 0x7f3e8005c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:33532/0 (socket says 172.21.15.31:33532) 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e85cf4700 1 -- 172.21.15.31:0/4238350989 learned_addr learned my addr 172.21.15.31:0/4238350989 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e85cf4700 1 -- 172.21.15.31:0/4238350989 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005be60 msgr2=0x7f3e8005c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e85cf4700 1 --2- 172.21.15.31:0/4238350989 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005be60 0x7f3e8005c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e85cf4700 1 -- 172.21.15.31:0/4238350989 >> v2:172.21.15.31:3300/0 conn(0x7f3e8005dfb0 msgr2=0x7f3e8005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e85cf4700 1 --2- 172.21.15.31:0/4238350989 >> v2:172.21.15.31:3300/0 conn(0x7f3e8005dfb0 0x7f3e8005b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e85cf4700 1 -- 172.21.15.31:0/4238350989 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800a49d0 con 0x7f3e80067d70 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.696+0000 7f3e854f3700 1 --2- 172.21.15.31:0/4238350989 >> v2:172.21.15.31:3300/0 conn(0x7f3e8005dfb0 0x7f3e8005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e85cf4700 1 --2- 172.21.15.31:0/4238350989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e80067d70 0x7f3e80066e70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3e8005c940 tx=0x7f3e70006eb0).ready entity=mon.1 client_cookie=5edc74063b1a03b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e84cf2700 1 -- 172.21.15.31:0/4238350989 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7000d570 con 0x7f3e80067d70 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e84cf2700 1 -- 172.21.15.31:0/4238350989 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e70000e90 con 0x7f3e80067d70 2024-04-26T07:28:20.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e84cf2700 1 -- 172.21.15.31:0/4238350989 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7000d900 con 0x7f3e80067d70 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 -- 172.21.15.31:0/4238350989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e80067d70 msgr2=0x7f3e80066e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 --2- 172.21.15.31:0/4238350989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e80067d70 0x7f3e80066e70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3e8005c940 tx=0x7f3e70006eb0).stop 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 -- 172.21.15.31:0/4238350989 shutdown_connections 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 --2- 172.21.15.31:0/4238350989 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005be60 0x7f3e8005c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 --2- 172.21.15.31:0/4238350989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e80067d70 0x7f3e80066e70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 --2- 172.21.15.31:0/4238350989 >> v2:172.21.15.31:3300/0 conn(0x7f3e8005dfb0 0x7f3e8005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 -- 172.21.15.31:0/4238350989 >> 172.21.15.31:0/4238350989 conn(0x7f3e80060ee0 msgr2=0x7f3e800a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 -- 172.21.15.31:0/4238350989 shutdown_connections 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.697+0000 7f3e87f58700 1 -- 172.21.15.31:0/4238350989 wait complete. 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.698+0000 7f3e87f58700 1 Processor -- start 2024-04-26T07:28:20.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.698+0000 7f3e87f58700 1 -- start start 2024-04-26T07:28:20.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e87f58700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8005be60 0x7f3e80093290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e87f58700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005dfb0 0x7f3e8009fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e87f58700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e80067d70 0x7f3e800a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:20.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e87f58700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800927f0 con 0x7f3e80067d70 2024-04-26T07:28:20.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e87f58700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800929f0 con 0x7f3e8005be60 2024-04-26T07:28:20.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e87f58700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800a2b40 con 0x7f3e8005dfb0 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e85cf4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8005be60 0x7f3e80093290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e864f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e80067d70 0x7f3e800a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e854f3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005dfb0 0x7f3e8009fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e854f3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005dfb0 0x7f3e8009fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:33548/0 (socket says 172.21.15.31:33548) 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e864f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e80067d70 0x7f3e800a00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43684/0 (socket says 172.21.15.31:43684) 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e854f3700 1 -- 172.21.15.31:0/2903756026 learned_addr learned my addr 172.21.15.31:0/2903756026 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e85cf4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8005be60 0x7f3e80093290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:45094/0 (socket says 172.21.15.31:45094) 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e864f5700 1 -- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005dfb0 msgr2=0x7f3e8009fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e864f5700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005dfb0 0x7f3e8009fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e864f5700 1 -- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8005be60 msgr2=0x7f3e80093290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e864f5700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8005be60 0x7f3e80093290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e864f5700 1 -- 172.21.15.31:0/2903756026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c00b180 con 0x7f3e80067d70 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e85cf4700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8005be60 0x7f3e80093290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e854f3700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005dfb0 0x7f3e8009fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e864f5700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e80067d70 0x7f3e800a00e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3e7800c000 tx=0x7f3e780091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.699+0000 7f3e6effd700 1 -- 172.21.15.31:0/2903756026 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e78012600 con 0x7f3e80067d70 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.700+0000 7f3e6effd700 1 -- 172.21.15.31:0/2903756026 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e78012760 con 0x7f3e80067d70 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.700+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7000b1e0 con 0x7f3e80067d70 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.700+0000 7f3e6effd700 1 -- 172.21.15.31:0/2903756026 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e78012ac0 con 0x7f3e80067d70 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.700+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e800a0df0 con 0x7f3e80067d70 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.701+0000 7f3e6effd700 1 -- 172.21.15.31:0/2903756026 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3e78022070 con 0x7f3e80067d70 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.701+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e800a38c0 con 0x7f3e80067d70 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.701+0000 7f3e6effd700 1 -- 172.21.15.31:0/2903756026 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2469+0+0 (secure 0 0 0) 0x7f3e7804a9b0 con 0x7f3e80067d70 2024-04-26T07:28:20.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.704+0000 7f3e6effd700 1 -- 172.21.15.31:0/2903756026 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3e78033790 con 0x7f3e80067d70 2024-04-26T07:28:20.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:20.819+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f3e8006bbc0 con 0x7f3e80067d70 2024-04-26T07:28:21.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.015+0000 7f3e6effd700 1 -- 172.21.15.31:0/2903756026 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3e78016030 con 0x7f3e80067d70 2024-04-26T07:28:21.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 >> v1:172.21.15.31:6816/39613 conn(0x7f3e60038da0 legacy=0x7f3e6003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:21.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e80067d70 msgr2=0x7f3e800a00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:21.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e80067d70 0x7f3e800a00e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3e7800c000 tx=0x7f3e780091d0).stop 2024-04-26T07:28:21.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 shutdown_connections 2024-04-26T07:28:21.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e80067d70 0x7f3e800a00e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8005be60 0x7f3e80093290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 --2- 172.21.15.31:0/2903756026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8005dfb0 0x7f3e8009fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 >> 172.21.15.31:0/2903756026 conn(0x7f3e80060ee0 msgr2=0x7f3e801377c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:21.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 shutdown_connections 2024-04-26T07:28:21.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.018+0000 7f3e87f58700 1 -- 172.21.15.31:0/2903756026 wait complete. 2024-04-26T07:28:21.020 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'rbd' created 2024-04-26T07:28:21.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T07:28:21.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.137+0000 7f2c83c4b700 1 Processor -- start 2024-04-26T07:28:21.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.137+0000 7f2c83c4b700 1 -- start start 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c83c4b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c1334f0 0x7f2c7c136370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c83c4b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c7c064850 0x7f2c7c1338d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c83c4b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c0a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c83c4b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c132e20 con 0x7f2c7c064850 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c83c4b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c133dc0 con 0x7f2c7c1334f0 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c83c4b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c068480 con 0x7f2c7c136b50 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c811e6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c7c064850 0x7f2c7c1338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c821e8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c0a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c819e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c1334f0 0x7f2c7c136370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c811e6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c7c064850 0x7f2c7c1338d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43692/0 (socket says 172.21.15.31:43692) 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c821e8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c0a81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:33556/0 (socket says 172.21.15.31:33556) 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c811e6700 1 -- 172.21.15.31:0/988291069 learned_addr learned my addr 172.21.15.31:0/988291069 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c819e7700 1 -- 172.21.15.31:0/988291069 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 msgr2=0x7f2c7c0a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c819e7700 1 --2- 172.21.15.31:0/988291069 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c0a81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.138+0000 7f2c819e7700 1 -- 172.21.15.31:0/988291069 >> v2:172.21.15.31:3300/0 conn(0x7f2c7c064850 msgr2=0x7f2c7c1338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c819e7700 1 --2- 172.21.15.31:0/988291069 >> v2:172.21.15.31:3300/0 conn(0x7f2c7c064850 0x7f2c7c1338d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c819e7700 1 -- 172.21.15.31:0/988291069 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c133010 con 0x7f2c7c1334f0 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c811e6700 1 --2- 172.21.15.31:0/988291069 >> v2:172.21.15.31:3300/0 conn(0x7f2c7c064850 0x7f2c7c1338d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c819e7700 1 --2- 172.21.15.31:0/988291069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c1334f0 0x7f2c7c136370 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2c7c0aa130 tx=0x7f2c6c006d90).ready entity=mon.1 client_cookie=ffbc61f5d2990b91 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c809e5700 1 -- 172.21.15.31:0/988291069 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6c00e470 con 0x7f2c7c1334f0 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c809e5700 1 -- 172.21.15.31:0/988291069 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c000e90 con 0x7f2c7c1334f0 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c809e5700 1 -- 172.21.15.31:0/988291069 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6c00e7c0 con 0x7f2c7c1334f0 2024-04-26T07:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c83c4b700 1 -- 172.21.15.31:0/988291069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c1334f0 msgr2=0x7f2c7c136370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c83c4b700 1 --2- 172.21.15.31:0/988291069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c1334f0 0x7f2c7c136370 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2c7c0aa130 tx=0x7f2c6c006d90).stop 2024-04-26T07:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c83c4b700 1 -- 172.21.15.31:0/988291069 shutdown_connections 2024-04-26T07:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c83c4b700 1 --2- 172.21.15.31:0/988291069 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c0a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c83c4b700 1 --2- 172.21.15.31:0/988291069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c1334f0 0x7f2c7c136370 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c83c4b700 1 --2- 172.21.15.31:0/988291069 >> v2:172.21.15.31:3300/0 conn(0x7f2c7c064850 0x7f2c7c1338d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.139+0000 7f2c83c4b700 1 -- 172.21.15.31:0/988291069 >> 172.21.15.31:0/988291069 conn(0x7f2c7c0613e0 msgr2=0x7f2c7c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.140+0000 7f2c83c4b700 1 -- 172.21.15.31:0/988291069 shutdown_connections 2024-04-26T07:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.140+0000 7f2c83c4b700 1 -- 172.21.15.31:0/988291069 wait complete. 2024-04-26T07:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c83c4b700 1 Processor -- start 2024-04-26T07:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c83c4b700 1 -- start start 2024-04-26T07:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c83c4b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c064850 0x7f2c7c137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c83c4b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c7c1334f0 0x7f2c7c12f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c83c4b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c12fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c83c4b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c13bde0 con 0x7f2c7c1334f0 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c83c4b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c138630 con 0x7f2c7c064850 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c83c4b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c065980 con 0x7f2c7c136b50 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c819e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c064850 0x7f2c7c137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c819e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c064850 0x7f2c7c137c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:45116/0 (socket says 172.21.15.31:45116) 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c819e7700 1 -- 172.21.15.31:0/2320542667 learned_addr learned my addr 172.21.15.31:0/2320542667 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.141+0000 7f2c821e8700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c12fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c811e6700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c7c1334f0 0x7f2c7c12f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c819e7700 1 -- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 msgr2=0x7f2c7c12fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c819e7700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c12fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c819e7700 1 -- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c7c1334f0 msgr2=0x7f2c7c12f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c819e7700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c7c1334f0 0x7f2c7c12f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c819e7700 1 -- 172.21.15.31:0/2320542667 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7800b1e0 con 0x7f2c7c064850 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c821e8700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c12fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c819e7700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c064850 0x7f2c7c137c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2c7c0aa130 tx=0x7f2c6c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c6affd700 1 -- 172.21.15.31:0/2320542667 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6c01c400 con 0x7f2c7c064850 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c6affd700 1 -- 172.21.15.31:0/2320542667 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c01c560 con 0x7f2c7c064850 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c00b120 con 0x7f2c7c064850 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c6affd700 1 -- 172.21.15.31:0/2320542667 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6c01c8c0 con 0x7f2c7c064850 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.142+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c067ed0 con 0x7f2c7c064850 2024-04-26T07:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.143+0000 7f2c6affd700 1 -- 172.21.15.31:0/2320542667 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2c6c00f070 con 0x7f2c7c064850 2024-04-26T07:28:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.143+0000 7f2c6affd700 1 -- 172.21.15.31:0/2320542667 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2811+0+0 (secure 0 0 0) 0x7f2c6c04b6a0 con 0x7f2c7c064850 2024-04-26T07:28:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.143+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c13a5a0 con 0x7f2c7c064850 2024-04-26T07:28:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.147+0000 7f2c6affd700 1 -- 172.21.15.31:0/2320542667 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2c6c0125d0 con 0x7f2c7c064850 2024-04-26T07:28:21.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:21.264+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2c7c1332d0 con 0x7f2c7c064850 2024-04-26T07:28:22.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.018+0000 7f2c6affd700 1 -- 172.21.15.31:0/2320542667 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2c6c001f00 con 0x7f2c7c064850 2024-04-26T07:28:22.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.021+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 >> v1:172.21.15.31:6816/39613 conn(0x7f2c5c038da0 legacy=0x7f2c5c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.021+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c064850 msgr2=0x7f2c7c137c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.021+0000 7f2c83c4b700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c064850 0x7f2c7c137c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2c7c0aa130 tx=0x7f2c6c014000).stop 2024-04-26T07:28:22.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.023+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 shutdown_connections 2024-04-26T07:28:22.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.023+0000 7f2c83c4b700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c7c136b50 0x7f2c7c12fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.023+0000 7f2c83c4b700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c7c064850 0x7f2c7c137c00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.023+0000 7f2c83c4b700 1 --2- 172.21.15.31:0/2320542667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c7c1334f0 0x7f2c7c12f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.023+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 >> 172.21.15.31:0/2320542667 conn(0x7f2c7c0613e0 msgr2=0x7f2c7c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:22.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.023+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 shutdown_connections 2024-04-26T07:28:22.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.023+0000 7f2c83c4b700 1 -- 172.21.15.31:0/2320542667 wait complete. 2024-04-26T07:28:22.025 INFO:teuthology.orchestra.run.smithi031.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T07:28:22.038 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T07:28:22.038 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T07:28:22.038 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T07:28:22.041 INFO:tasks.ceph.mds.a:Started 2024-04-26T07:28:22.041 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T07:28:22.041 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T07:28:22.043 INFO:tasks.ceph.mds.b:Started 2024-04-26T07:28:22.043 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T07:28:22.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T07:28:22.045 INFO:tasks.ceph.mds.c:Started 2024-04-26T07:28:22.045 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T07:28:22.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:22.128 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2024-04-26T07:28:22.128 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-04-26T07:28:22.132 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-04-26T07:28:22.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.167+0000 7f3e5fb69700 1 Processor -- start 2024-04-26T07:28:22.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.167+0000 7f3e5fb69700 1 -- start start 2024-04-26T07:28:22.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5fb69700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e580648b0 0x7f3e58136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5fb69700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e58133340 0x7f3e581337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5fb69700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5806cd70 con 0x7f3e5806c990 2024-04-26T07:28:22.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5fb69700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e58137340 con 0x7f3e58133340 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5fb69700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58132eb0 con 0x7f3e580648b0 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5d104700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e580648b0 0x7f3e58136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5d905700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3e5806c990 0x7f3e58136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34912/0 (socket says 172.21.15.31:34912) 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5d905700 1 -- 172.21.15.31:0/1564769164 learned_addr learned my addr 172.21.15.31:0/1564769164 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5e106700 1 --2- 172.21.15.31:0/1564769164 >> v2:172.21.15.31:3300/0 conn(0x7f3e58133340 0x7f3e581337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5d104700 1 -- 172.21.15.31:0/1564769164 >> v2:172.21.15.31:3300/0 conn(0x7f3e58133340 msgr2=0x7f3e581337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5d104700 1 --2- 172.21.15.31:0/1564769164 >> v2:172.21.15.31:3300/0 conn(0x7f3e58133340 0x7f3e581337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5d104700 1 -- 172.21.15.31:0/1564769164 >> v1:172.21.15.31:6789/0 conn(0x7f3e5806c990 legacy=0x7f3e58136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5d104700 1 -- 172.21.15.31:0/1564769164 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58063c00 con 0x7f3e580648b0 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5e106700 1 --2- 172.21.15.31:0/1564769164 >> v2:172.21.15.31:3300/0 conn(0x7f3e58133340 0x7f3e581337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5d104700 1 --2- 172.21.15.31:0/1564769164 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e580648b0 0x7f3e58136400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3e580a9bc0 tx=0x7f3e54006df0).ready entity=mon.1 client_cookie=20f628c8fe074a36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5c903700 1 -- 172.21.15.31:0/1564769164 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e54014070 con 0x7f3e580648b0 2024-04-26T07:28:22.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5c903700 1 -- 172.21.15.31:0/1564769164 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e54000e90 con 0x7f3e580648b0 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.168+0000 7f3e5c903700 1 -- 172.21.15.31:0/1564769164 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e5400fb60 con 0x7f3e580648b0 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.169+0000 7f3e5fb69700 1 -- 172.21.15.31:0/1564769164 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e580648b0 msgr2=0x7f3e58136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.169+0000 7f3e5fb69700 1 --2- 172.21.15.31:0/1564769164 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e580648b0 0x7f3e58136400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3e580a9bc0 tx=0x7f3e54006df0).stop 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.169+0000 7f3e5fb69700 1 -- 172.21.15.31:0/1564769164 shutdown_connections 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.169+0000 7f3e5fb69700 1 --2- 172.21.15.31:0/1564769164 >> v2:172.21.15.31:3300/0 conn(0x7f3e58133340 0x7f3e581337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.169+0000 7f3e5fb69700 1 --2- 172.21.15.31:0/1564769164 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e580648b0 0x7f3e58136400 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.169+0000 7f3e5fb69700 1 -- 172.21.15.31:0/1564769164 >> 172.21.15.31:0/1564769164 conn(0x7f3e58061370 msgr2=0x7f3e5806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.169+0000 7f3e5fb69700 1 -- 172.21.15.31:0/1564769164 shutdown_connections 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.169+0000 7f3e5fb69700 1 -- 172.21.15.31:0/1564769164 wait complete. 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5fb69700 1 Processor -- start 2024-04-26T07:28:22.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5fb69700 1 -- start start 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5fb69700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e580648b0 0x7f3e5809e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5fb69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e5806c990 0x7f3e58096320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5fb69700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e58133340 0x7f3e58096810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5fb69700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58098560 con 0x7f3e5806c990 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5fb69700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58097c40 con 0x7f3e58133340 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5fb69700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58098800 con 0x7f3e580648b0 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5e106700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e58133340 0x7f3e58096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5d104700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e5806c990 0x7f3e58096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5e106700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e58133340 0x7f3e58096810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:45154/0 (socket says 172.21.15.31:45154) 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5e106700 1 -- 172.21.15.31:0/3529407538 learned_addr learned my addr 172.21.15.31:0/3529407538 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5d905700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e580648b0 0x7f3e5809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.170+0000 7f3e5d104700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e5806c990 0x7f3e58096320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43734/0 (socket says 172.21.15.31:43734) 2024-04-26T07:28:22.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5e106700 1 -- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e580648b0 msgr2=0x7f3e5809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5e106700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e580648b0 0x7f3e5809e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5e106700 1 -- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e5806c990 msgr2=0x7f3e58096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5e106700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e5806c990 0x7f3e58096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5e106700 1 -- 172.21.15.31:0/3529407538 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009470 con 0x7f3e58133340 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5d104700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e5806c990 0x7f3e58096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5e106700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e58133340 0x7f3e58096810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3e5000c000 tx=0x7f3e500091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e46ffd700 1 -- 172.21.15.31:0/3529407538 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e500096b0 con 0x7f3e58133340 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e46ffd700 1 -- 172.21.15.31:0/3529407538 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000c850 con 0x7f3e58133340 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e46ffd700 1 -- 172.21.15.31:0/3529407538 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e5000cbb0 con 0x7f3e58133340 2024-04-26T07:28:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5400b180 con 0x7f3e58133340 2024-04-26T07:28:22.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.171+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e58068070 con 0x7f3e58133340 2024-04-26T07:28:22.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.172+0000 7f3e46ffd700 1 -- 172.21.15.31:0/3529407538 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3e50022070 con 0x7f3e58133340 2024-04-26T07:28:22.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.172+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5806bbc0 con 0x7f3e58133340 2024-04-26T07:28:22.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.172+0000 7f3e46ffd700 1 -- 172.21.15.31:0/3529407538 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f3e5004ab30 con 0x7f3e58133340 2024-04-26T07:28:22.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.175+0000 7f3e46ffd700 1 -- 172.21.15.31:0/3529407538 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3e50016070 con 0x7f3e58133340 2024-04-26T07:28:22.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.292+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e58132240 con 0x7f3e58133340 2024-04-26T07:28:22.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.293+0000 7f3e46ffd700 1 -- 172.21.15.31:0/3529407538 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7622 (secure 0 0 0) 0x7f3e50016020 con 0x7f3e58133340 2024-04-26T07:28:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:22.294 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":13,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:22.013570+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 >> v1:172.21.15.31:6816/39613 conn(0x7f3e38038f80 legacy=0x7f3e3803b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e58133340 msgr2=0x7f3e58096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e58133340 0x7f3e58096810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3e5000c000 tx=0x7f3e500091d0).stop 2024-04-26T07:28:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 shutdown_connections 2024-04-26T07:28:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e580648b0 0x7f3e5809e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e58133340 0x7f3e58096810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 --2- 172.21.15.31:0/3529407538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e5806c990 0x7f3e58096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 >> 172.21.15.31:0/3529407538 conn(0x7f3e58061370 msgr2=0x7f3e580a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 shutdown_connections 2024-04-26T07:28:22.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.294+0000 7f3e5fb69700 1 -- 172.21.15.31:0/3529407538 wait complete. 2024-04-26T07:28:22.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-26T07:28:22.306 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:28:22.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd27514700 1 Processor -- start 2024-04-26T07:28:22.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd27514700 1 -- start start 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd27514700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a22a0 0x7fbd2009c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd27514700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd200a2680 0x7fbd200a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd27514700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a3660 0x7fbd200a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd27514700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200a4000 con 0x7fbd200a2680 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd27514700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2009d150 con 0x7fbd200a3660 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd27514700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2009dd80 con 0x7fbd200a22a0 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd25ab1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a3660 0x7fbd200a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.414+0000 7fbd24aaf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd200a2680 0x7fbd200a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd252b0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a22a0 0x7fbd2009c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd24aaf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd200a2680 0x7fbd200a3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43736/0 (socket says 172.21.15.31:43736) 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd25ab1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a3660 0x7fbd200a3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:45162/0 (socket says 172.21.15.31:45162) 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd25ab1700 1 -- 172.21.15.31:0/3277327090 learned_addr learned my addr 172.21.15.31:0/3277327090 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd252b0700 1 -- 172.21.15.31:0/3277327090 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a3660 msgr2=0x7fbd200a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd252b0700 1 --2- 172.21.15.31:0/3277327090 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a3660 0x7fbd200a3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd252b0700 1 -- 172.21.15.31:0/3277327090 >> v2:172.21.15.31:3300/0 conn(0x7fbd200a2680 msgr2=0x7fbd200a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd252b0700 1 --2- 172.21.15.31:0/3277327090 >> v2:172.21.15.31:3300/0 conn(0x7fbd200a2680 0x7fbd200a3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd252b0700 1 -- 172.21.15.31:0/3277327090 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2009ce90 con 0x7fbd200a22a0 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd25ab1700 1 --2- 172.21.15.31:0/3277327090 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a3660 0x7fbd200a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd24aaf700 1 --2- 172.21.15.31:0/3277327090 >> v2:172.21.15.31:3300/0 conn(0x7fbd200a2680 0x7fbd200a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd252b0700 1 --2- 172.21.15.31:0/3277327090 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a22a0 0x7fbd2009c7d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fbd200a4140 tx=0x7fbd10006df0).ready entity=mon.2 client_cookie=3c7414bae02a705d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd0ffff700 1 -- 172.21.15.31:0/3277327090 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1000d570 con 0x7fbd200a22a0 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd0ffff700 1 -- 172.21.15.31:0/3277327090 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10000e90 con 0x7fbd200a22a0 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.415+0000 7fbd0ffff700 1 -- 172.21.15.31:0/3277327090 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1000d8c0 con 0x7fbd200a22a0 2024-04-26T07:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 -- 172.21.15.31:0/3277327090 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a22a0 msgr2=0x7fbd2009c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 --2- 172.21.15.31:0/3277327090 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a22a0 0x7fbd2009c7d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fbd200a4140 tx=0x7fbd10006df0).stop 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 -- 172.21.15.31:0/3277327090 shutdown_connections 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 --2- 172.21.15.31:0/3277327090 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a3660 0x7fbd200a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 --2- 172.21.15.31:0/3277327090 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a22a0 0x7fbd2009c7d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 --2- 172.21.15.31:0/3277327090 >> v2:172.21.15.31:3300/0 conn(0x7fbd200a2680 0x7fbd200a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 -- 172.21.15.31:0/3277327090 >> 172.21.15.31:0/3277327090 conn(0x7fbd20060ee0 msgr2=0x7fbd200a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 -- 172.21.15.31:0/3277327090 shutdown_connections 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.416+0000 7fbd27514700 1 -- 172.21.15.31:0/3277327090 wait complete. 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd27514700 1 Processor -- start 2024-04-26T07:28:22.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd27514700 1 -- start start 2024-04-26T07:28:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd27514700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a22a0 0x7fbd2013b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd27514700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a2680 0x7fbd201330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd27514700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200a3660 0x7fbd20133590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd27514700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2013ad60 con 0x7fbd200a3660 2024-04-26T07:28:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd27514700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2013bb60 con 0x7fbd200a22a0 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd27514700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20138ae0 con 0x7fbd200a2680 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd24aaf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a2680 0x7fbd201330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd25ab1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200a3660 0x7fbd20133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd24aaf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a2680 0x7fbd201330a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:33596/0 (socket says 172.21.15.31:33596) 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd25ab1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200a3660 0x7fbd20133590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43752/0 (socket says 172.21.15.31:43752) 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd24aaf700 1 -- 172.21.15.31:0/2815539797 learned_addr learned my addr 172.21.15.31:0/2815539797 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.417+0000 7fbd252b0700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a22a0 0x7fbd2013b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd25ab1700 1 -- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a2680 msgr2=0x7fbd201330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd25ab1700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a2680 0x7fbd201330a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd25ab1700 1 -- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a22a0 msgr2=0x7fbd2013b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd25ab1700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a22a0 0x7fbd2013b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd25ab1700 1 -- 172.21.15.31:0/2815539797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c00b180 con 0x7fbd200a3660 2024-04-26T07:28:22.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd24aaf700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a2680 0x7fbd201330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd252b0700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a22a0 0x7fbd2013b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd25ab1700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200a3660 0x7fbd20133590 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbd1800c000 tx=0x7fbd18009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd0e7fc700 1 -- 172.21.15.31:0/2815539797 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1800c770 con 0x7fbd200a3660 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd0e7fc700 1 -- 172.21.15.31:0/2815539797 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1800c8d0 con 0x7fbd200a3660 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd0e7fc700 1 -- 172.21.15.31:0/2815539797 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1800cc30 con 0x7fbd200a3660 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd18009530 con 0x7fbd200a3660 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.418+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1000b180 con 0x7fbd200a3660 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.419+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2013aed0 con 0x7fbd200a3660 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.419+0000 7fbd0e7fc700 1 -- 172.21.15.31:0/2815539797 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbd18022070 con 0x7fbd200a3660 2024-04-26T07:28:22.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.420+0000 7fbd0e7fc700 1 -- 172.21.15.31:0/2815539797 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fbd1804abd0 con 0x7fbd200a3660 2024-04-26T07:28:22.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.423+0000 7fbd0e7fc700 1 -- 172.21.15.31:0/2815539797 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbd2013aed0 con 0x7fbd200a3660 2024-04-26T07:28:22.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.541+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbd2013aea0 con 0x7fbd200a3660 2024-04-26T07:28:22.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.542+0000 7fbd0e7fc700 1 -- 172.21.15.31:0/2815539797 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbd18016030 con 0x7fbd200a3660 2024-04-26T07:28:22.543 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:28:22.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 >> v1:172.21.15.31:6816/39613 conn(0x7fbd00038dd0 legacy=0x7fbd0003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200a3660 msgr2=0x7fbd20133590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200a3660 0x7fbd20133590 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbd1800c000 tx=0x7fbd18009290).stop 2024-04-26T07:28:22.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 shutdown_connections 2024-04-26T07:28:22.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200a3660 0x7fbd20133590 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd200a22a0 0x7fbd2013b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 --2- 172.21.15.31:0/2815539797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd200a2680 0x7fbd201330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 >> 172.21.15.31:0/2815539797 conn(0x7fbd20060ee0 msgr2=0x7fbd2005b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:22.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 shutdown_connections 2024-04-26T07:28:22.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.543+0000 7fbd27514700 1 -- 172.21.15.31:0/2815539797 wait complete. 2024-04-26T07:28:22.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:28:22.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.663+0000 7f7f9d6e0700 1 Processor -- start 2024-04-26T07:28:22.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.663+0000 7f7f9d6e0700 1 -- start start 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f9d6e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f980aca60 0x7f7f980ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f9d6e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f9805cbb0 0x7f7f98139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f9d6e0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9805b970 con 0x7f7f980a8af0 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f9d6e0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9805c3d0 con 0x7f7f980aca60 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f9d6e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9805d300 con 0x7f7f9805cbb0 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f9805cbb0 0x7f7f98139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f96ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f980aca60 0x7f7f980ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f9805cbb0 0x7f7f98139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:33606/0 (socket says 172.21.15.31:33606) 2024-04-26T07:28:22.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f977fe700 1 -- 172.21.15.31:0/155805271 learned_addr learned my addr 172.21.15.31:0/155805271 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f96ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f980aca60 0x7f7f980ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43766/0 (socket says 172.21.15.31:43766) 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.664+0000 7f7f967fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7f980a8af0 0x7f7f98139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34922/0 (socket says 172.21.15.31:34922) 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f96ffd700 1 -- 172.21.15.31:0/155805271 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f9805cbb0 msgr2=0x7f7f98139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f96ffd700 1 --2- 172.21.15.31:0/155805271 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f9805cbb0 0x7f7f98139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f96ffd700 1 -- 172.21.15.31:0/155805271 >> v1:172.21.15.31:6789/0 conn(0x7f7f980a8af0 legacy=0x7f7f98139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f96ffd700 1 -- 172.21.15.31:0/155805271 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980ac400 con 0x7f7f980aca60 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f95ffb700 1 -- 172.21.15.31:0/155805271 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926249472 0 0) 0x7f7f9805b970 con 0x7f7f980a8af0 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f977fe700 1 --2- 172.21.15.31:0/155805271 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f9805cbb0 0x7f7f98139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f96ffd700 1 --2- 172.21.15.31:0/155805271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 0x7f7f980ace40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7f8c002f70 tx=0x7f7f8c006df0).ready entity=mon.0 client_cookie=cd0df0b4e8379625 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f95ffb700 1 -- 172.21.15.31:0/155805271 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8c00d570 con 0x7f7f980aca60 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f95ffb700 1 -- 172.21.15.31:0/155805271 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c000e90 con 0x7f7f980aca60 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.665+0000 7f7f95ffb700 1 -- 172.21.15.31:0/155805271 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8c00d8c0 con 0x7f7f980aca60 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.666+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/155805271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 msgr2=0x7f7f980ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.666+0000 7f7f9d6e0700 1 --2- 172.21.15.31:0/155805271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 0x7f7f980ace40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7f8c002f70 tx=0x7f7f8c006df0).stop 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.666+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/155805271 shutdown_connections 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.666+0000 7f7f9d6e0700 1 --2- 172.21.15.31:0/155805271 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f9805cbb0 0x7f7f98139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.666+0000 7f7f9d6e0700 1 --2- 172.21.15.31:0/155805271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 0x7f7f980ace40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.666+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/155805271 >> 172.21.15.31:0/155805271 conn(0x7f7f98066d50 msgr2=0x7f7f98067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.666+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/155805271 shutdown_connections 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.666+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/155805271 wait complete. 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.667+0000 7f7f9d6e0700 1 Processor -- start 2024-04-26T07:28:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.667+0000 7f7f9d6e0700 1 -- start start 2024-04-26T07:28:22.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f9d6e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f9805cbb0 0x7f7f98115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f9d6e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f980a8af0 0x7f7f98116e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f9d6e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 0x7f7f981490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f9d6e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98116620 con 0x7f7f980aca60 2024-04-26T07:28:22.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f9d6e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98116900 con 0x7f7f9805cbb0 2024-04-26T07:28:22.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f9d6e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98148b40 con 0x7f7f980a8af0 2024-04-26T07:28:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f9805cbb0 0x7f7f98115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 0x7f7f981490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f967fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f980a8af0 0x7f7f98116e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f9805cbb0 0x7f7f98115b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:45180/0 (socket says 172.21.15.31:45180) 2024-04-26T07:28:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 0x7f7f981490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43774/0 (socket says 172.21.15.31:43774) 2024-04-26T07:28:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f967fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f980a8af0 0x7f7f98116e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:33616/0 (socket says 172.21.15.31:33616) 2024-04-26T07:28:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 -- 172.21.15.31:0/1036008017 learned_addr learned my addr 172.21.15.31:0/1036008017 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 -- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f980a8af0 msgr2=0x7f7f98116e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 --2- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f980a8af0 0x7f7f98116e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 -- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 msgr2=0x7f7f981490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 --2- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 0x7f7f981490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 -- 172.21.15.31:0/1036008017 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90009530 con 0x7f7f9805cbb0 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f96ffd700 1 --2- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f9805cbb0 0x7f7f98115b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7f8c002f70 tx=0x7f7f8c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f87fff700 1 -- 172.21.15.31:0/1036008017 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8c013de0 con 0x7f7f9805cbb0 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f87fff700 1 -- 172.21.15.31:0/1036008017 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c01e400 con 0x7f7f9805cbb0 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f87fff700 1 -- 172.21.15.31:0/1036008017 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8c01e760 con 0x7f7f9805cbb0 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c00b180 con 0x7f7f9805cbb0 2024-04-26T07:28:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.668+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f98148de0 con 0x7f7f9805cbb0 2024-04-26T07:28:22.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.669+0000 7f7f87fff700 1 -- 172.21.15.31:0/1036008017 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7f8c025030 con 0x7f7f9805cbb0 2024-04-26T07:28:22.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.669+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9805d020 con 0x7f7f9805cbb0 2024-04-26T07:28:22.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.670+0000 7f7f87fff700 1 -- 172.21.15.31:0/1036008017 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f7f8c04b2f0 con 0x7f7f9805cbb0 2024-04-26T07:28:22.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.673+0000 7f7f87fff700 1 -- 172.21.15.31:0/1036008017 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7f8c001f00 con 0x7f7f9805cbb0 2024-04-26T07:28:22.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.790+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7f98116a40 con 0x7f7f9805cbb0 2024-04-26T07:28:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.790+0000 7f7f87fff700 1 -- 172.21.15.31:0/1036008017 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7f98116a40 con 0x7f7f9805cbb0 2024-04-26T07:28:22.792 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:28:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 >> v1:172.21.15.31:6816/39613 conn(0x7f7f74038e30 legacy=0x7f7f7403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f9805cbb0 msgr2=0x7f7f98115b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 --2- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f9805cbb0 0x7f7f98115b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7f8c002f70 tx=0x7f7f8c014000).stop 2024-04-26T07:28:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 shutdown_connections 2024-04-26T07:28:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 --2- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f980aca60 0x7f7f981490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 --2- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f9805cbb0 0x7f7f98115b80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 --2- 172.21.15.31:0/1036008017 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f980a8af0 0x7f7f98116e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 >> 172.21.15.31:0/1036008017 conn(0x7f7f98066d50 msgr2=0x7f7f980a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:22.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 shutdown_connections 2024-04-26T07:28:22.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.792+0000 7f7f9d6e0700 1 -- 172.21.15.31:0/1036008017 wait complete. 2024-04-26T07:28:22.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:22.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e93283700 1 Processor -- start 2024-04-26T07:28:22.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e93283700 1 -- start start 2024-04-26T07:28:22.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e93283700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e8c0679d0 0x7f3e8c1339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e93283700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c13ea20 0x7f3e8c140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e93283700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8c133ea0 con 0x7f3e8c1335d0 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e93283700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c0670c0 con 0x7f3e8c0679d0 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e93283700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c066600 con 0x7f3e8c13ea20 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e9081e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e8c0679d0 0x7f3e8c1339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.910+0000 7f3e91820700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c13ea20 0x7f3e8c140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e9081e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e8c0679d0 0x7f3e8c1339b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43790/0 (socket says 172.21.15.31:43790) 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e91820700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c13ea20 0x7f3e8c140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:45196/0 (socket says 172.21.15.31:45196) 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e9081e700 1 -- 172.21.15.31:0/3298830551 learned_addr learned my addr 172.21.15.31:0/3298830551 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e9101f700 1 --1- 172.21.15.31:0/3298830551 >> v1:172.21.15.31:6789/0 conn(0x7f3e8c1335d0 0x7f3e8c0a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34936/0 (socket says 172.21.15.31:34936) 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e9081e700 1 -- 172.21.15.31:0/3298830551 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c13ea20 msgr2=0x7f3e8c140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e9081e700 1 --2- 172.21.15.31:0/3298830551 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c13ea20 0x7f3e8c140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e9081e700 1 -- 172.21.15.31:0/3298830551 >> v1:172.21.15.31:6789/0 conn(0x7f3e8c1335d0 legacy=0x7f3e8c0a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e9081e700 1 -- 172.21.15.31:0/3298830551 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c066de0 con 0x7f3e8c0679d0 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e7bfff700 1 -- 172.21.15.31:0/3298830551 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542404744 0 0) 0x7f3e8c133ea0 con 0x7f3e8c1335d0 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e91820700 1 --2- 172.21.15.31:0/3298830551 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c13ea20 0x7f3e8c140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e9081e700 1 --2- 172.21.15.31:0/3298830551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c0679d0 0x7f3e8c1339b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3e88002f70 tx=0x7f3e88006eb0).ready entity=mon.0 client_cookie=e43e825476c6a62f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e7bfff700 1 -- 172.21.15.31:0/3298830551 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e8800d570 con 0x7f3e8c0679d0 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e7bfff700 1 -- 172.21.15.31:0/3298830551 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e88000e90 con 0x7f3e8c0679d0 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.911+0000 7f3e7bfff700 1 -- 172.21.15.31:0/3298830551 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e8800d8c0 con 0x7f3e8c0679d0 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.912+0000 7f3e93283700 1 -- 172.21.15.31:0/3298830551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c0679d0 msgr2=0x7f3e8c1339b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.912+0000 7f3e93283700 1 --2- 172.21.15.31:0/3298830551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c0679d0 0x7f3e8c1339b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3e88002f70 tx=0x7f3e88006eb0).stop 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.912+0000 7f3e93283700 1 -- 172.21.15.31:0/3298830551 shutdown_connections 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.912+0000 7f3e93283700 1 --2- 172.21.15.31:0/3298830551 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c13ea20 0x7f3e8c140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.912+0000 7f3e93283700 1 --2- 172.21.15.31:0/3298830551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c0679d0 0x7f3e8c1339b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.912+0000 7f3e93283700 1 -- 172.21.15.31:0/3298830551 >> 172.21.15.31:0/3298830551 conn(0x7f3e8c060ee0 msgr2=0x7f3e8c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.912+0000 7f3e93283700 1 -- 172.21.15.31:0/3298830551 shutdown_connections 2024-04-26T07:28:22.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.912+0000 7f3e93283700 1 -- 172.21.15.31:0/3298830551 wait complete. 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e93283700 1 Processor -- start 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e93283700 1 -- start start 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e93283700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c0679d0 0x7f3e8c0a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e93283700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c1335d0 0x7f3e8c130700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e93283700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8c13ea20 0x7f3e8c130bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e93283700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0a1150 con 0x7f3e8c1335d0 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e93283700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0a0ee0 con 0x7f3e8c0679d0 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e93283700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c1366a0 con 0x7f3e8c13ea20 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e9081e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c1335d0 0x7f3e8c130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e9081e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c1335d0 0x7f3e8c130700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43802/0 (socket says 172.21.15.31:43802) 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e9081e700 1 -- 172.21.15.31:0/2289081714 learned_addr learned my addr 172.21.15.31:0/2289081714 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e9101f700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c0679d0 0x7f3e8c0a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.913+0000 7f3e91820700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8c13ea20 0x7f3e8c130bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e9081e700 1 -- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8c13ea20 msgr2=0x7f3e8c130bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e9081e700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8c13ea20 0x7f3e8c130bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e9081e700 1 -- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c0679d0 msgr2=0x7f3e8c0a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e9081e700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c0679d0 0x7f3e8c0a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e9081e700 1 -- 172.21.15.31:0/2289081714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84009470 con 0x7f3e8c1335d0 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e9081e700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c1335d0 0x7f3e8c130700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3e88002f70 tx=0x7f3e88015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e7a7fc700 1 -- 172.21.15.31:0/2289081714 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e88011710 con 0x7f3e8c1335d0 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e7a7fc700 1 -- 172.21.15.31:0/2289081714 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e88011870 con 0x7f3e8c1335d0 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8800b1e0 con 0x7f3e8c1335d0 2024-04-26T07:28:22.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e7a7fc700 1 -- 172.21.15.31:0/2289081714 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e88011bd0 con 0x7f3e8c1335d0 2024-04-26T07:28:22.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.914+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c0a06e0 con 0x7f3e8c1335d0 2024-04-26T07:28:22.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.915+0000 7f3e7a7fc700 1 -- 172.21.15.31:0/2289081714 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3e8801a040 con 0x7f3e8c1335d0 2024-04-26T07:28:22.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.915+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c067e60 con 0x7f3e8c1335d0 2024-04-26T07:28:22.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.915+0000 7f3e7a7fc700 1 -- 172.21.15.31:0/2289081714 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f3e8804b450 con 0x7f3e8c1335d0 2024-04-26T07:28:22.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:22.918+0000 7f3e7a7fc700 1 -- 172.21.15.31:0/2289081714 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3e880087d0 con 0x7f3e8c1335d0 2024-04-26T07:28:23.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.071+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e8c09ff70 con 0x7f3e8c1335d0 2024-04-26T07:28:23.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.071+0000 7f3e7a7fc700 1 -- 172.21.15.31:0/2289081714 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+794 (secure 0 0 0) 0x7f3e88023070 con 0x7f3e8c1335d0 2024-04-26T07:28:23.073 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:23.073 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-04-26T07:28:23.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 >> v1:172.21.15.31:6816/39613 conn(0x7f3e6c038da0 legacy=0x7f3e6c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:23.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c1335d0 msgr2=0x7f3e8c130700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:23.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c1335d0 0x7f3e8c130700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3e88002f70 tx=0x7f3e88015000).stop 2024-04-26T07:28:23.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 shutdown_connections 2024-04-26T07:28:23.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e8c13ea20 0x7f3e8c130bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:23.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e8c0679d0 0x7f3e8c0a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:23.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 --2- 172.21.15.31:0/2289081714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e8c1335d0 0x7f3e8c130700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:23.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 >> 172.21.15.31:0/2289081714 conn(0x7f3e8c060ee0 msgr2=0x7f3e8c1396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:23.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 shutdown_connections 2024-04-26T07:28:23.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:23.073+0000 7f3e93283700 1 -- 172.21.15.31:0/2289081714 wait complete. 2024-04-26T07:28:23.075 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-04-26T07:28:25.085 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.204+0000 7f58c528c700 1 Processor -- start 2024-04-26T07:28:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.205+0000 7f58c528c700 1 -- start start 2024-04-26T07:28:25.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.205+0000 7f58c528c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c00ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:25.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.205+0000 7f58c528c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58c005cbb0 0x7f58c0139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:25.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.205+0000 7f58c528c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c005b970 con 0x7f58c00a8af0 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.205+0000 7f58c528c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c005c3d0 con 0x7f58c005cbb0 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.205+0000 7f58c528c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c005d300 con 0x7f58c00aca60 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58bf7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58c005cbb0 0x7f58c0139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58beffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c00ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58be7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f58c00a8af0 0x7f58c0139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34946/0 (socket says 172.21.15.31:34946) 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58be7fc700 1 -- 172.21.15.31:0/2623107196 learned_addr learned my addr 172.21.15.31:0/2623107196 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58beffd700 1 -- 172.21.15.31:0/2623107196 >> v2:172.21.15.31:3300/0 conn(0x7f58c005cbb0 msgr2=0x7f58c0139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58beffd700 1 --2- 172.21.15.31:0/2623107196 >> v2:172.21.15.31:3300/0 conn(0x7f58c005cbb0 0x7f58c0139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58beffd700 1 -- 172.21.15.31:0/2623107196 >> v1:172.21.15.31:6789/0 conn(0x7f58c00a8af0 legacy=0x7f58c0139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58bdffb700 1 -- 172.21.15.31:0/2623107196 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585093993 0 0) 0x7f58c005b970 con 0x7f58c00a8af0 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58beffd700 1 -- 172.21.15.31:0/2623107196 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c00ac400 con 0x7f58c00aca60 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58bf7fe700 1 --2- 172.21.15.31:0/2623107196 >> v2:172.21.15.31:3300/0 conn(0x7f58c005cbb0 0x7f58c0139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58beffd700 1 --2- 172.21.15.31:0/2623107196 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c00ace40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f58b0002f70 tx=0x7f58b0006df0).ready entity=mon.1 client_cookie=7b4407a77196b39a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58bdffb700 1 -- 172.21.15.31:0/2623107196 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b000d570 con 0x7f58c00aca60 2024-04-26T07:28:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58bdffb700 1 -- 172.21.15.31:0/2623107196 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0000e90 con 0x7f58c00aca60 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.206+0000 7f58bdffb700 1 -- 172.21.15.31:0/2623107196 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b000d8c0 con 0x7f58c00aca60 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.207+0000 7f58c528c700 1 -- 172.21.15.31:0/2623107196 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 msgr2=0x7f58c00ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.207+0000 7f58c528c700 1 --2- 172.21.15.31:0/2623107196 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c00ace40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f58b0002f70 tx=0x7f58b0006df0).stop 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.207+0000 7f58c528c700 1 -- 172.21.15.31:0/2623107196 shutdown_connections 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.207+0000 7f58c528c700 1 --2- 172.21.15.31:0/2623107196 >> v2:172.21.15.31:3300/0 conn(0x7f58c005cbb0 0x7f58c0139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.207+0000 7f58c528c700 1 --2- 172.21.15.31:0/2623107196 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c00ace40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.207+0000 7f58c528c700 1 -- 172.21.15.31:0/2623107196 >> 172.21.15.31:0/2623107196 conn(0x7f58c0066d50 msgr2=0x7f58c0067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.207+0000 7f58c528c700 1 -- 172.21.15.31:0/2623107196 shutdown_connections 2024-04-26T07:28:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.207+0000 7f58c528c700 1 -- 172.21.15.31:0/2623107196 wait complete. 2024-04-26T07:28:25.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.208+0000 7f58c528c700 1 Processor -- start 2024-04-26T07:28:25.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.208+0000 7f58c528c700 1 -- start start 2024-04-26T07:28:25.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.208+0000 7f58c528c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c005cbb0 0x7f58c00a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:25.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58c528c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58c00a8af0 0x7f58c01342a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:25.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58c528c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c0115f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:25.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58c528c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c01153a0 con 0x7f58c005cbb0 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58c528c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c00a5b80 con 0x7f58c00aca60 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58c528c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58c01140e0 con 0x7f58c00a8af0 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58beffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c005cbb0 0x7f58c00a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c0115f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58beffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c005cbb0 0x7f58c00a4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43824/0 (socket says 172.21.15.31:43824) 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58beffd700 1 -- 172.21.15.31:0/1399322554 learned_addr learned my addr 172.21.15.31:0/1399322554 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58be7fc700 1 --2- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58c00a8af0 0x7f58c01342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58bf7fe700 1 -- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58c00a8af0 msgr2=0x7f58c01342a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58bf7fe700 1 --2- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58c00a8af0 0x7f58c01342a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58bf7fe700 1 -- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c005cbb0 msgr2=0x7f58c00a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58bf7fe700 1 --2- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c005cbb0 0x7f58c00a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58bf7fe700 1 -- 172.21.15.31:0/1399322554 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8009470 con 0x7f58c00aca60 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58bf7fe700 1 --2- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c0115f70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f58b800c000 tx=0x7f58b80091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58b7fff700 1 -- 172.21.15.31:0/1399322554 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b800ee60 con 0x7f58c00aca60 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58b7fff700 1 -- 172.21.15.31:0/1399322554 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b800c850 con 0x7f58c00aca60 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b000b180 con 0x7f58c00aca60 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58b7fff700 1 -- 172.21.15.31:0/1399322554 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b800cbb0 con 0x7f58c00aca60 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.209+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c0114430 con 0x7f58c00aca60 2024-04-26T07:28:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.210+0000 7f58b7fff700 1 -- 172.21.15.31:0/1399322554 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f58b8022070 con 0x7f58c00aca60 2024-04-26T07:28:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.210+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c0116ab0 con 0x7f58c00aca60 2024-04-26T07:28:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.210+0000 7f58b7fff700 1 -- 172.21.15.31:0/1399322554 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f58b804ac10 con 0x7f58c00aca60 2024-04-26T07:28:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.214+0000 7f58b7fff700 1 -- 172.21.15.31:0/1399322554 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f58c0116ab0 con 0x7f58c00aca60 2024-04-26T07:28:25.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.364+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58c0116ab0 con 0x7f58c00aca60 2024-04-26T07:28:25.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.364+0000 7f58b7fff700 1 -- 172.21.15.31:0/1399322554 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+794 (secure 0 0 0) 0x7f58c0116ab0 con 0x7f58c00aca60 2024-04-26T07:28:25.366 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:25.366 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-04-26T07:28:25.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 >> v1:172.21.15.31:6816/39613 conn(0x7f58a4038da0 legacy=0x7f58a403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 msgr2=0x7f58c0115f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 --2- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c0115f70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f58b800c000 tx=0x7f58b80091d0).stop 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 shutdown_connections 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 --2- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58c00aca60 0x7f58c0115f70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 --2- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58c005cbb0 0x7f58c00a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 --2- 172.21.15.31:0/1399322554 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58c00a8af0 0x7f58c01342a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 >> 172.21.15.31:0/1399322554 conn(0x7f58c0066d50 msgr2=0x7f58c00a1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 shutdown_connections 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:25.366+0000 7f58c528c700 1 -- 172.21.15.31:0/1399322554 wait complete. 2024-04-26T07:28:25.368 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-04-26T07:28:27.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:27.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.496+0000 7eff1213c700 1 Processor -- start 2024-04-26T07:28:27.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff1213c700 1 -- start start 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff1213c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c05dfb0 0x7eff0c1330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff1213c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c133590 0x7eff0c133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff1213c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c133f10 con 0x7eff0c067d70 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff1213c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c067580 con 0x7eff0c05dfb0 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff1213c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c066600 con 0x7eff0c133590 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff0bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c133590 0x7eff0c133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff0b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff0c067d70 0x7eff0c066e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46518/0 (socket says 172.21.15.31:46518) 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff0affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c05dfb0 0x7eff0c1330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.497+0000 7eff0b7fe700 1 -- 172.21.15.31:0/3662870858 learned_addr learned my addr 172.21.15.31:0/3662870858 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0bfff700 1 -- 172.21.15.31:0/3662870858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c05dfb0 msgr2=0x7eff0c1330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0a7fc700 1 -- 172.21.15.31:0/3662870858 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774861868 0 0) 0x7efefc001110 con 0x7eff0c067d70 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0bfff700 1 --2- 172.21.15.31:0/3662870858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c05dfb0 0x7eff0c1330a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0bfff700 1 -- 172.21.15.31:0/3662870858 >> v1:172.21.15.31:6789/0 conn(0x7eff0c067d70 legacy=0x7eff0c066e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0bfff700 1 -- 172.21.15.31:0/3662870858 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0a4730 con 0x7eff0c133590 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0bfff700 1 --2- 172.21.15.31:0/3662870858 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c133590 0x7eff0c133a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7eff040032f0 tx=0x7eff040091d0).ready entity=mon.2 client_cookie=e09ffaf6cbae674c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0a7fc700 1 -- 172.21.15.31:0/3662870858 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff0400b660 con 0x7eff0c133590 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0a7fc700 1 -- 172.21.15.31:0/3662870858 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0400b7c0 con 0x7eff0c133590 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.498+0000 7eff0a7fc700 1 -- 172.21.15.31:0/3662870858 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff0400b930 con 0x7eff0c133590 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.499+0000 7eff1213c700 1 -- 172.21.15.31:0/3662870858 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c133590 msgr2=0x7eff0c133a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.499+0000 7eff1213c700 1 --2- 172.21.15.31:0/3662870858 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c133590 0x7eff0c133a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7eff040032f0 tx=0x7eff040091d0).stop 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.499+0000 7eff1213c700 1 -- 172.21.15.31:0/3662870858 shutdown_connections 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.499+0000 7eff1213c700 1 --2- 172.21.15.31:0/3662870858 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c133590 0x7eff0c133a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.499+0000 7eff1213c700 1 --2- 172.21.15.31:0/3662870858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c05dfb0 0x7eff0c1330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.499+0000 7eff1213c700 1 -- 172.21.15.31:0/3662870858 >> 172.21.15.31:0/3662870858 conn(0x7eff0c060ee0 msgr2=0x7eff0c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:27.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.499+0000 7eff1213c700 1 -- 172.21.15.31:0/3662870858 shutdown_connections 2024-04-26T07:28:27.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.499+0000 7eff1213c700 1 -- 172.21.15.31:0/3662870858 wait complete. 2024-04-26T07:28:27.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff1213c700 1 Processor -- start 2024-04-26T07:28:27.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff1213c700 1 -- start start 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff1213c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c05dfb0 0x7eff0c0a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff1213c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c067d70 0x7eff0c1340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff1213c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c133590 0x7eff0c145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff1213c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c09f480 con 0x7eff0c067d70 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff1213c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0a1fb0 con 0x7eff0c133590 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff1213c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c09edd0 con 0x7eff0c05dfb0 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.500+0000 7eff0affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c067d70 0x7eff0c1340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c05dfb0 0x7eff0c0a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c067d70 0x7eff0c1340b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36492/0 (socket says 172.21.15.31:36492) 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0affd700 1 -- 172.21.15.31:0/3234602704 learned_addr learned my addr 172.21.15.31:0/3234602704 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0bfff700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c133590 0x7eff0c145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0b7fe700 1 -- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c133590 msgr2=0x7eff0c145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0b7fe700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c133590 0x7eff0c145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0b7fe700 1 -- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c067d70 msgr2=0x7eff0c1340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0b7fe700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c067d70 0x7eff0c1340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0b7fe700 1 -- 172.21.15.31:0/3234602704 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009470 con 0x7eff0c05dfb0 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0bfff700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c133590 0x7eff0c145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0affd700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c067d70 0x7eff0c1340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff0b7fe700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c05dfb0 0x7eff0c0a1ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efefc000bc0 tx=0x7efefc007840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff08ff9700 1 -- 172.21.15.31:0/3234602704 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc00ce00 con 0x7eff0c05dfb0 2024-04-26T07:28:27.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff08ff9700 1 -- 172.21.15.31:0/3234602704 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc0070d0 con 0x7eff0c05dfb0 2024-04-26T07:28:27.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c1432a0 con 0x7eff0c05dfb0 2024-04-26T07:28:27.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff08ff9700 1 -- 172.21.15.31:0/3234602704 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc007430 con 0x7eff0c05dfb0 2024-04-26T07:28:27.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.501+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c0a2560 con 0x7eff0c05dfb0 2024-04-26T07:28:27.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.502+0000 7eff08ff9700 1 -- 172.21.15.31:0/3234602704 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7efefc010070 con 0x7eff0c05dfb0 2024-04-26T07:28:27.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.502+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c0a09a0 con 0x7eff0c05dfb0 2024-04-26T07:28:27.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.502+0000 7eff08ff9700 1 -- 172.21.15.31:0/3234602704 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7efefc0499c0 con 0x7eff0c05dfb0 2024-04-26T07:28:27.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.506+0000 7eff08ff9700 1 -- 172.21.15.31:0/3234602704 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7efefc02ebb0 con 0x7eff0c05dfb0 2024-04-26T07:28:27.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.652+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff0c133f10 con 0x7eff0c05dfb0 2024-04-26T07:28:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.652+0000 7eff08ff9700 1 -- 172.21.15.31:0/3234602704 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1378 (secure 0 0 0) 0x7eff0c133f10 con 0x7eff0c05dfb0 2024-04-26T07:28:27.654 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4207,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[]} 2024-04-26T07:28:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.653+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 >> v1:172.21.15.31:6816/39613 conn(0x7efef0038e30 legacy=0x7efef003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.653+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c05dfb0 msgr2=0x7eff0c0a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.653+0000 7eff1213c700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c05dfb0 0x7eff0c0a1ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efefc000bc0 tx=0x7efefc007840).stop 2024-04-26T07:28:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.653+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 shutdown_connections 2024-04-26T07:28:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.654+0000 7eff1213c700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff0c05dfb0 0x7eff0c0a1ac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.654+0000 7eff1213c700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff0c133590 0x7eff0c145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.654+0000 7eff1213c700 1 --2- 172.21.15.31:0/3234602704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c067d70 0x7eff0c1340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.654+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 >> 172.21.15.31:0/3234602704 conn(0x7eff0c060ee0 msgr2=0x7eff0c139ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.654+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 shutdown_connections 2024-04-26T07:28:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.654+0000 7eff1213c700 1 -- 172.21.15.31:0/3234602704 wait complete. 2024-04-26T07:28:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2024-04-26T07:28:27.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:27.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.771+0000 7fec6d512700 1 Processor -- start 2024-04-26T07:28:27.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.771+0000 7fec6d512700 1 -- start start 2024-04-26T07:28:27.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec6d512700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680a8af0 0x7fec680ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec6d512700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec6805cbb0 0x7fec68139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec6d512700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6805b970 con 0x7fec680aca60 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec6d512700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6805c3d0 con 0x7fec6805cbb0 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec6d512700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec6805d300 con 0x7fec680a8af0 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec667fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680a8af0 0x7fec680ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec677fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec6805cbb0 0x7fec68139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec66ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fec680aca60 0x7fec68139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46522/0 (socket says 172.21.15.31:46522) 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec66ffd700 1 -- 172.21.15.31:0/3829912340 learned_addr learned my addr 172.21.15.31:0/3829912340 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec65ffb700 1 -- 172.21.15.31:0/3829912340 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840460984 0 0) 0x7fec6805b970 con 0x7fec680aca60 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec65ffb700 1 -- 172.21.15.31:0/3829912340 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec4c003260 con 0x7fec680aca60 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec667fc700 1 -- 172.21.15.31:0/3829912340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec6805cbb0 msgr2=0x7fec68139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec667fc700 1 --2- 172.21.15.31:0/3829912340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec6805cbb0 0x7fec68139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec667fc700 1 -- 172.21.15.31:0/3829912340 >> v1:172.21.15.31:6789/0 conn(0x7fec680aca60 legacy=0x7fec68139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec667fc700 1 -- 172.21.15.31:0/3829912340 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680ac400 con 0x7fec680a8af0 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec677fe700 1 --2- 172.21.15.31:0/3829912340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec6805cbb0 0x7fec68139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.772+0000 7fec667fc700 1 --2- 172.21.15.31:0/3829912340 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680a8af0 0x7fec680ace40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fec58002f70 tx=0x7fec58006df0).ready entity=mon.2 client_cookie=644ef3756568edf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec65ffb700 1 -- 172.21.15.31:0/3829912340 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5800d570 con 0x7fec680a8af0 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec65ffb700 1 -- 172.21.15.31:0/3829912340 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec58000e90 con 0x7fec680a8af0 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec65ffb700 1 -- 172.21.15.31:0/3829912340 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5800d8c0 con 0x7fec680a8af0 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec6d512700 1 -- 172.21.15.31:0/3829912340 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680a8af0 msgr2=0x7fec680ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec6d512700 1 --2- 172.21.15.31:0/3829912340 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680a8af0 0x7fec680ace40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fec58002f70 tx=0x7fec58006df0).stop 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec6d512700 1 -- 172.21.15.31:0/3829912340 shutdown_connections 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec6d512700 1 --2- 172.21.15.31:0/3829912340 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec6805cbb0 0x7fec68139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec6d512700 1 --2- 172.21.15.31:0/3829912340 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680a8af0 0x7fec680ace40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec6d512700 1 -- 172.21.15.31:0/3829912340 >> 172.21.15.31:0/3829912340 conn(0x7fec68066d50 msgr2=0x7fec68067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec6d512700 1 -- 172.21.15.31:0/3829912340 shutdown_connections 2024-04-26T07:28:27.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.773+0000 7fec6d512700 1 -- 172.21.15.31:0/3829912340 wait complete. 2024-04-26T07:28:27.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.774+0000 7fec6d512700 1 Processor -- start 2024-04-26T07:28:27.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.774+0000 7fec6d512700 1 -- start start 2024-04-26T07:28:27.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec6d512700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6805cbb0 0x7fec68116f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec6d512700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec680a8af0 0x7fec680a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec6d512700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680aca60 0x7fec68148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:27.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec6d512700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec68114210 con 0x7fec6805cbb0 2024-04-26T07:28:27.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec6d512700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec68145bf0 con 0x7fec680a8af0 2024-04-26T07:28:27.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec6d512700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec68145eb0 con 0x7fec680aca60 2024-04-26T07:28:27.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec680a8af0 0x7fec680a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec66ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6805cbb0 0x7fec68116f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec680a8af0 0x7fec680a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39114/0 (socket says 172.21.15.31:39114) 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 -- 172.21.15.31:0/3435095663 learned_addr learned my addr 172.21.15.31:0/3435095663 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec677fe700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680aca60 0x7fec68148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 -- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680aca60 msgr2=0x7fec68148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680aca60 0x7fec68148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 -- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6805cbb0 msgr2=0x7fec68116f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6805cbb0 0x7fec68116f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 -- 172.21.15.31:0/3435095663 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec60009470 con 0x7fec680a8af0 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec66ffd700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6805cbb0 0x7fec68116f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec667fc700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec680a8af0 0x7fec680a5850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fec58002f70 tx=0x7fec58014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec57fff700 1 -- 172.21.15.31:0/3435095663 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5800dea0 con 0x7fec680a8af0 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec57fff700 1 -- 172.21.15.31:0/3435095663 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec58013e90 con 0x7fec680a8af0 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec57fff700 1 -- 172.21.15.31:0/3435095663 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5801e5f0 con 0x7fec680a8af0 2024-04-26T07:28:27.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5800b180 con 0x7fec680a8af0 2024-04-26T07:28:27.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.775+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec68117430 con 0x7fec680a8af0 2024-04-26T07:28:27.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.776+0000 7fec57fff700 1 -- 172.21.15.31:0/3435095663 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fec5801c070 con 0x7fec680a8af0 2024-04-26T07:28:27.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.776+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6805d040 con 0x7fec680a8af0 2024-04-26T07:28:27.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.776+0000 7fec57fff700 1 -- 172.21.15.31:0/3435095663 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fec5804afa0 con 0x7fec680a8af0 2024-04-26T07:28:27.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.779+0000 7fec57fff700 1 -- 172.21.15.31:0/3435095663 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fec5801fe60 con 0x7fec680a8af0 2024-04-26T07:28:27.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.898+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec6806bbc0 con 0x7fec680a8af0 2024-04-26T07:28:27.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.899+0000 7fec57fff700 1 -- 172.21.15.31:0/3435095663 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7609 (secure 0 0 0) 0x7fec5801fa50 con 0x7fec680a8af0 2024-04-26T07:28:27.900 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:27.900 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":14,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:23.023039+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:27.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 >> v1:172.21.15.31:6816/39613 conn(0x7fec44038ef0 legacy=0x7fec4403b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec680a8af0 msgr2=0x7fec680a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec680a8af0 0x7fec680a5850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fec58002f70 tx=0x7fec58014000).stop 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 shutdown_connections 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec680aca60 0x7fec68148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6805cbb0 0x7fec68116f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 --2- 172.21.15.31:0/3435095663 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec680a8af0 0x7fec680a5850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 >> 172.21.15.31:0/3435095663 conn(0x7fec68066d50 msgr2=0x7fec680a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 shutdown_connections 2024-04-26T07:28:27.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:27.900+0000 7fec6d512700 1 -- 172.21.15.31:0/3435095663 wait complete. 2024-04-26T07:28:27.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-26T07:28:27.912 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:28:28.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.021+0000 7f31d33f9700 1 Processor -- start 2024-04-26T07:28:28.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.021+0000 7f31d33f9700 1 -- start start 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d33f9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d33f9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc1337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d33f9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc06cd70 con 0x7f31cc06c990 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d33f9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc137340 con 0x7f31cc0648b0 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d33f9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc132eb0 con 0x7f31cc133340 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d0994700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d1996700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc1337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d0994700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39124/0 (socket says 172.21.15.31:39124) 2024-04-26T07:28:28.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d1996700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc1337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40322/0 (socket says 172.21.15.31:40322) 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d0994700 1 -- 172.21.15.31:0/750652422 learned_addr learned my addr 172.21.15.31:0/750652422 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d1195700 1 --1- 172.21.15.31:0/750652422 >> v1:172.21.15.31:6789/0 conn(0x7f31cc06c990 0x7f31cc136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46526/0 (socket says 172.21.15.31:46526) 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d1996700 1 -- 172.21.15.31:0/750652422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 msgr2=0x7f31cc136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d1996700 1 --2- 172.21.15.31:0/750652422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d1996700 1 -- 172.21.15.31:0/750652422 >> v1:172.21.15.31:6789/0 conn(0x7f31cc06c990 legacy=0x7f31cc136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31bbfff700 1 -- 172.21.15.31:0/750652422 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210321493 0 0) 0x7f31cc06cd70 con 0x7f31cc06c990 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d1996700 1 -- 172.21.15.31:0/750652422 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc063c00 con 0x7f31cc133340 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d0994700 1 --2- 172.21.15.31:0/750652422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.022+0000 7f31d1996700 1 --2- 172.21.15.31:0/750652422 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc1337d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f31c40032f0 tx=0x7f31c40091d0).ready entity=mon.2 client_cookie=d3de55ab841eefe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31bbfff700 1 -- 172.21.15.31:0/750652422 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c400b660 con 0x7f31cc133340 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31bbfff700 1 -- 172.21.15.31:0/750652422 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c400b7c0 con 0x7f31cc133340 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31bbfff700 1 -- 172.21.15.31:0/750652422 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c400b930 con 0x7f31cc133340 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31d33f9700 1 -- 172.21.15.31:0/750652422 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 msgr2=0x7f31cc1337d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31d33f9700 1 --2- 172.21.15.31:0/750652422 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc1337d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f31c40032f0 tx=0x7f31c40091d0).stop 2024-04-26T07:28:28.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31d33f9700 1 -- 172.21.15.31:0/750652422 shutdown_connections 2024-04-26T07:28:28.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31d33f9700 1 --2- 172.21.15.31:0/750652422 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc1337d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31d33f9700 1 --2- 172.21.15.31:0/750652422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31d33f9700 1 -- 172.21.15.31:0/750652422 >> 172.21.15.31:0/750652422 conn(0x7f31cc061370 msgr2=0x7f31cc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:28.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31d33f9700 1 -- 172.21.15.31:0/750652422 shutdown_connections 2024-04-26T07:28:28.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.023+0000 7f31d33f9700 1 -- 172.21.15.31:0/750652422 wait complete. 2024-04-26T07:28:28.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.024+0000 7f31d33f9700 1 Processor -- start 2024-04-26T07:28:28.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.024+0000 7f31d33f9700 1 -- start start 2024-04-26T07:28:28.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d33f9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc093e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d33f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc06c990 0x7f31cc145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d33f9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc066020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d33f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc094350 con 0x7f31cc06c990 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d33f9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1463f0 con 0x7f31cc0648b0 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d33f9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1466b0 con 0x7f31cc133340 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc093e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d0994700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc06c990 0x7f31cc145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc093e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39138/0 (socket says 172.21.15.31:39138) 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 -- 172.21.15.31:0/1295614560 learned_addr learned my addr 172.21.15.31:0/1295614560 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1996700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc066020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 -- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 msgr2=0x7f31cc066020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc066020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 -- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc06c990 msgr2=0x7f31cc145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc06c990 0x7f31cc145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 -- 172.21.15.31:0/1295614560 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c800b1e0 con 0x7f31cc0648b0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d0994700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc06c990 0x7f31cc145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d1195700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc093e60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f31bc000bc0 tx=0x7f31bc007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31ba7fc700 1 -- 172.21.15.31:0/1295614560 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31bc0070d0 con 0x7f31cc0648b0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31ba7fc700 1 -- 172.21.15.31:0/1295614560 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc007230 con 0x7f31cc0648b0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c4009470 con 0x7f31cc0648b0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.025+0000 7f31ba7fc700 1 -- 172.21.15.31:0/1295614560 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31bc005740 con 0x7f31cc0648b0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.026+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc13c430 con 0x7f31cc0648b0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.026+0000 7f31ba7fc700 1 -- 172.21.15.31:0/1295614560 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f31bc01a060 con 0x7f31cc0648b0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.026+0000 7f31ba7fc700 1 -- 172.21.15.31:0/1295614560 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f31bc049920 con 0x7f31cc0648b0 2024-04-26T07:28:28.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.027+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc133cc0 con 0x7f31cc0648b0 2024-04-26T07:28:28.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.030+0000 7f31ba7fc700 1 -- 172.21.15.31:0/1295614560 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f31bc018080 con 0x7f31cc0648b0 2024-04-26T07:28:28.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.150+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f31cc06bbc0 con 0x7f31cc0648b0 2024-04-26T07:28:28.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.150+0000 7f31ba7fc700 1 -- 172.21.15.31:0/1295614560 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v14) v1 ==== 110+0+10 (secure 0 0 0) 0x7f31bc02eb70 con 0x7f31cc0648b0 2024-04-26T07:28:28.154 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:28:28.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.151+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 >> v1:172.21.15.31:6816/39613 conn(0x7f31ac038f80 legacy=0x7f31ac03b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.151+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 msgr2=0x7f31cc093e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.151+0000 7f31d33f9700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc093e60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f31bc000bc0 tx=0x7f31bc007a60).stop 2024-04-26T07:28:28.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.152+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 shutdown_connections 2024-04-26T07:28:28.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.152+0000 7f31d33f9700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31cc133340 0x7f31cc066020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.152+0000 7f31d33f9700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0648b0 0x7f31cc093e60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.152+0000 7f31d33f9700 1 --2- 172.21.15.31:0/1295614560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc06c990 0x7f31cc145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.152+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 >> 172.21.15.31:0/1295614560 conn(0x7f31cc061370 msgr2=0x7f31cc062800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:28.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.152+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 shutdown_connections 2024-04-26T07:28:28.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.152+0000 7f31d33f9700 1 -- 172.21.15.31:0/1295614560 wait complete. 2024-04-26T07:28:28.164 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:28:28.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.272+0000 7fa2e1bd4700 1 Processor -- start 2024-04-26T07:28:28.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.272+0000 7fa2e1bd4700 1 -- start start 2024-04-26T07:28:28.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2e1bd4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2e1bd4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2dc09ff30 0x7fa2dc0a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2e1bd4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc05b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2e1bd4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0a4e20 con 0x7fa2dc09ff30 2024-04-26T07:28:28.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2e1bd4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc137620 con 0x7fa2dc137a50 2024-04-26T07:28:28.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2e1bd4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc138320 con 0x7fa2dc0a3740 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2daffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2dc09ff30 0x7fa2dc0a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2db7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2dbfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc05b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2daffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2dc09ff30 0x7fa2dc0a3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36528/0 (socket says 172.21.15.31:36528) 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2dbfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc05b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40348/0 (socket says 172.21.15.31:40348) 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2db7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc137e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39154/0 (socket says 172.21.15.31:39154) 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2daffd700 1 -- 172.21.15.31:0/3531697951 learned_addr learned my addr 172.21.15.31:0/3531697951 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2dbfff700 1 -- 172.21.15.31:0/3531697951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 msgr2=0x7fa2dc137e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2dbfff700 1 --2- 172.21.15.31:0/3531697951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc137e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2dbfff700 1 -- 172.21.15.31:0/3531697951 >> v2:172.21.15.31:3300/0 conn(0x7fa2dc09ff30 msgr2=0x7fa2dc0a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2dbfff700 1 --2- 172.21.15.31:0/3531697951 >> v2:172.21.15.31:3300/0 conn(0x7fa2dc09ff30 0x7fa2dc0a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2dbfff700 1 -- 172.21.15.31:0/3531697951 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0a46a0 con 0x7fa2dc0a3740 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2daffd700 1 --2- 172.21.15.31:0/3531697951 >> v2:172.21.15.31:3300/0 conn(0x7fa2dc09ff30 0x7fa2dc0a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2db7fe700 1 --2- 172.21.15.31:0/3531697951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2dbfff700 1 --2- 172.21.15.31:0/3531697951 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc05b970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa2cc002f70 tx=0x7fa2cc006df0).ready entity=mon.2 client_cookie=9ab1786587eaa4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.273+0000 7fa2da7fc700 1 -- 172.21.15.31:0/3531697951 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2cc00d4a0 con 0x7fa2dc0a3740 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2da7fc700 1 -- 172.21.15.31:0/3531697951 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc000e90 con 0x7fa2dc0a3740 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2da7fc700 1 -- 172.21.15.31:0/3531697951 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2cc00d7f0 con 0x7fa2dc0a3740 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/3531697951 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 msgr2=0x7fa2dc05b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 --2- 172.21.15.31:0/3531697951 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc05b970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa2cc002f70 tx=0x7fa2cc006df0).stop 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/3531697951 shutdown_connections 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 --2- 172.21.15.31:0/3531697951 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc05b970 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 --2- 172.21.15.31:0/3531697951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 --2- 172.21.15.31:0/3531697951 >> v2:172.21.15.31:3300/0 conn(0x7fa2dc09ff30 0x7fa2dc0a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/3531697951 >> 172.21.15.31:0/3531697951 conn(0x7fa2dc060ee0 msgr2=0x7fa2dc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/3531697951 shutdown_connections 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.274+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/3531697951 wait complete. 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.275+0000 7fa2e1bd4700 1 Processor -- start 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.275+0000 7fa2e1bd4700 1 -- start start 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2e1bd4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09ff30 0x7fa2dc09e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2e1bd4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2e1bd4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2e1bd4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc148ae0 con 0x7fa2dc09ff30 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2e1bd4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc09ccf0 con 0x7fa2dc137a50 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2e1bd4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc09c7d0 con 0x7fa2dc0a3740 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2dbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2db7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09ff30 0x7fa2dc09e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2daffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2db7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09ff30 0x7fa2dc09e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36538/0 (socket says 172.21.15.31:36538) 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2dbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39156/0 (socket says 172.21.15.31:39156) 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2db7fe700 1 -- 172.21.15.31:0/2396701483 learned_addr learned my addr 172.21.15.31:0/2396701483 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2daffd700 1 -- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 msgr2=0x7fa2dc149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2daffd700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2daffd700 1 -- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09ff30 msgr2=0x7fa2dc09e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2daffd700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09ff30 0x7fa2dc09e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2daffd700 1 -- 172.21.15.31:0/2396701483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d000b1e0 con 0x7fa2dc0a3740 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2db7fe700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09ff30 0x7fa2dc09e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2dbfff700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2daffd700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc148ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa2d000c000 tx=0x7fa2d0006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2d8ff9700 1 -- 172.21.15.31:0/2396701483 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d0012600 con 0x7fa2dc0a3740 2024-04-26T07:28:28.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2d8ff9700 1 -- 172.21.15.31:0/2396701483 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0012760 con 0x7fa2dc0a3740 2024-04-26T07:28:28.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2d8ff9700 1 -- 172.21.15.31:0/2396701483 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d0012ac0 con 0x7fa2dc0a3740 2024-04-26T07:28:28.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d4009470 con 0x7fa2dc0a3740 2024-04-26T07:28:28.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.276+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc00b180 con 0x7fa2dc0a3740 2024-04-26T07:28:28.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.277+0000 7fa2d8ff9700 1 -- 172.21.15.31:0/2396701483 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa2d0012c20 con 0x7fa2dc0a3740 2024-04-26T07:28:28.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.278+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc0a0350 con 0x7fa2dc0a3740 2024-04-26T07:28:28.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.278+0000 7fa2d8ff9700 1 -- 172.21.15.31:0/2396701483 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fa2d004a880 con 0x7fa2dc0a3740 2024-04-26T07:28:28.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.281+0000 7fa2d8ff9700 1 -- 172.21.15.31:0/2396701483 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa2d0033500 con 0x7fa2dc0a3740 2024-04-26T07:28:28.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.396+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2dc06bbc0 con 0x7fa2dc0a3740 2024-04-26T07:28:28.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.397+0000 7fa2d8ff9700 1 -- 172.21.15.31:0/2396701483 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa2d00330f0 con 0x7fa2dc0a3740 2024-04-26T07:28:28.399 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:28:28.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 >> v1:172.21.15.31:6816/39613 conn(0x7fa2bc038f80 legacy=0x7fa2bc03b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 msgr2=0x7fa2dc148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc148ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa2d000c000 tx=0x7fa2d0006eb0).stop 2024-04-26T07:28:28.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 shutdown_connections 2024-04-26T07:28:28.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2dc137a50 0x7fa2dc149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09ff30 0x7fa2dc09e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 --2- 172.21.15.31:0/2396701483 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2dc0a3740 0x7fa2dc148ea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 >> 172.21.15.31:0/2396701483 conn(0x7fa2dc060ee0 msgr2=0x7fa2dc05c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:28.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 shutdown_connections 2024-04-26T07:28:28.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.398+0000 7fa2e1bd4700 1 -- 172.21.15.31:0/2396701483 wait complete. 2024-04-26T07:28:28.411 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T07:28:28.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.517+0000 7f46bd117700 1 Processor -- start 2024-04-26T07:28:28.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.517+0000 7f46bd117700 1 -- start start 2024-04-26T07:28:28.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.517+0000 7f46bd117700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b81360f0 0x7f46b8096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.517+0000 7f46bd117700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46b805c080 0x7f46b8141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.517+0000 7f46bd117700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b80970a0 con 0x7f46b806c7d0 2024-04-26T07:28:28.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.517+0000 7f46bd117700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b8133c10 con 0x7f46b805c080 2024-04-26T07:28:28.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.517+0000 7f46bd117700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8096810 con 0x7f46b81360f0 2024-04-26T07:28:28.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46b805c080 0x7f46b8141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b81360f0 0x7f46b8096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b6d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f46b806c7d0 0x7f46b805b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46540/0 (socket says 172.21.15.31:46540) 2024-04-26T07:28:28.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b6d9d700 1 -- 172.21.15.31:0/3765091240 learned_addr learned my addr 172.21.15.31:0/3765091240 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:28.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b759e700 1 -- 172.21.15.31:0/3765091240 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b81360f0 msgr2=0x7f46b8096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:28.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b759e700 1 --2- 172.21.15.31:0/3765091240 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b81360f0 0x7f46b8096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b759e700 1 -- 172.21.15.31:0/3765091240 >> v1:172.21.15.31:6789/0 conn(0x7f46b806c7d0 legacy=0x7f46b805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b759e700 1 -- 172.21.15.31:0/3765091240 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b81364d0 con 0x7f46b805c080 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b5d9b700 1 -- 172.21.15.31:0/3765091240 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557723254 0 0) 0x7f46b80970a0 con 0x7f46b806c7d0 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b659c700 1 --2- 172.21.15.31:0/3765091240 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b81360f0 0x7f46b8096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b759e700 1 --2- 172.21.15.31:0/3765091240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b805c080 0x7f46b8141a50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f46b00032f0 tx=0x7f46b00091d0).ready entity=mon.0 client_cookie=7dc26c9257c42317 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b5d9b700 1 -- 172.21.15.31:0/3765091240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b000b6c0 con 0x7f46b805c080 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b5d9b700 1 -- 172.21.15.31:0/3765091240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000b820 con 0x7f46b805c080 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.518+0000 7f46b5d9b700 1 -- 172.21.15.31:0/3765091240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b000b990 con 0x7f46b805c080 2024-04-26T07:28:28.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.519+0000 7f46bd117700 1 -- 172.21.15.31:0/3765091240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b805c080 msgr2=0x7f46b8141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.519+0000 7f46bd117700 1 --2- 172.21.15.31:0/3765091240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b805c080 0x7f46b8141a50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f46b00032f0 tx=0x7f46b00091d0).stop 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.519+0000 7f46bd117700 1 -- 172.21.15.31:0/3765091240 shutdown_connections 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.519+0000 7f46bd117700 1 --2- 172.21.15.31:0/3765091240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b805c080 0x7f46b8141a50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.519+0000 7f46bd117700 1 --2- 172.21.15.31:0/3765091240 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b81360f0 0x7f46b8096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.519+0000 7f46bd117700 1 -- 172.21.15.31:0/3765091240 >> 172.21.15.31:0/3765091240 conn(0x7f46b8061370 msgr2=0x7f46b806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.519+0000 7f46bd117700 1 -- 172.21.15.31:0/3765091240 shutdown_connections 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.519+0000 7f46bd117700 1 -- 172.21.15.31:0/3765091240 wait complete. 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.520+0000 7f46bd117700 1 Processor -- start 2024-04-26T07:28:28.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.520+0000 7f46bd117700 1 -- start start 2024-04-26T07:28:28.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.520+0000 7f46bd117700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b805c080 0x7f46b8065d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.520+0000 7f46bd117700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b806c7d0 0x7f46b812f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.520+0000 7f46bd117700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81360f0 0x7f46b812fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.520+0000 7f46bd117700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b80651f0 con 0x7f46b81360f0 2024-04-26T07:28:28.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.520+0000 7f46bd117700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b80654d0 con 0x7f46b806c7d0 2024-04-26T07:28:28.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.520+0000 7f46bd117700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8063db0 con 0x7f46b805c080 2024-04-26T07:28:28.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b805c080 0x7f46b8065d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81360f0 0x7f46b812fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b805c080 0x7f46b8065d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40354/0 (socket says 172.21.15.31:40354) 2024-04-26T07:28:28.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b6d9d700 1 -- 172.21.15.31:0/2490688783 learned_addr learned my addr 172.21.15.31:0/2490688783 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:28.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b659c700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b806c7d0 0x7f46b812f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b759e700 1 -- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b805c080 msgr2=0x7f46b8065d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b759e700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b805c080 0x7f46b8065d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b759e700 1 -- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b806c7d0 msgr2=0x7f46b812f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b759e700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b806c7d0 0x7f46b812f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b759e700 1 -- 172.21.15.31:0/2490688783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac00b180 con 0x7f46b81360f0 2024-04-26T07:28:28.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b6d9d700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b805c080 0x7f46b8065d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46b759e700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81360f0 0x7f46b812fdf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f46b00032f0 tx=0x7f46b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:28.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46a7fff700 1 -- 172.21.15.31:0/2490688783 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b000b6c0 con 0x7f46b81360f0 2024-04-26T07:28:28.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46a7fff700 1 -- 172.21.15.31:0/2490688783 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0021630 con 0x7f46b81360f0 2024-04-26T07:28:28.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46a7fff700 1 -- 172.21.15.31:0/2490688783 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b0021990 con 0x7f46b81360f0 2024-04-26T07:28:28.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b0009470 con 0x7f46b81360f0 2024-04-26T07:28:28.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.521+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b8134e60 con 0x7f46b81360f0 2024-04-26T07:28:28.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.522+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b8063450 con 0x7f46b81360f0 2024-04-26T07:28:28.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.522+0000 7f46a7fff700 1 -- 172.21.15.31:0/2490688783 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f46b0029070 con 0x7f46b81360f0 2024-04-26T07:28:28.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.523+0000 7f46a7fff700 1 -- 172.21.15.31:0/2490688783 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f46b004b4e0 con 0x7f46b81360f0 2024-04-26T07:28:28.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.526+0000 7f46a7fff700 1 -- 172.21.15.31:0/2490688783 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f46b8063450 con 0x7f46b81360f0 2024-04-26T07:28:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.644+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f46b8063450 con 0x7f46b81360f0 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.644+0000 7f46a7fff700 1 -- 172.21.15.31:0/2490688783 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v14) v1 ==== 84+0+143 (secure 0 0 0) 0x7f46b8063450 con 0x7f46b81360f0 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": "device_health_metrics" 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 2, 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": "rbd" 2024-04-26T07:28:28.646 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-26T07:28:28.647 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 >> v1:172.21.15.31:6816/39613 conn(0x7f4694038da0 legacy=0x7f469403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81360f0 msgr2=0x7f46b812fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81360f0 0x7f46b812fdf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f46b00032f0 tx=0x7f46b0016000).stop 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 shutdown_connections 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f46b805c080 0x7f46b8065d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81360f0 0x7f46b812fdf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 --2- 172.21.15.31:0/2490688783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46b806c7d0 0x7f46b812f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 >> 172.21.15.31:0/2490688783 conn(0x7f46b8061370 msgr2=0x7f46b80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 shutdown_connections 2024-04-26T07:28:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.646+0000 7f46bd117700 1 -- 172.21.15.31:0/2490688783 wait complete. 2024-04-26T07:28:28.658 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T07:28:28.658 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T07:28:28.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.767+0000 7f9b4804a700 1 Processor -- start 2024-04-26T07:28:28.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.767+0000 7f9b4804a700 1 -- start start 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.767+0000 7f9b4804a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b4013a120 0x7f9b40096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.767+0000 7f9b4804a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40140d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.767+0000 7f9b4804a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b40097020 con 0x7f9b40139d40 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.767+0000 7f9b4804a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b401395c0 con 0x7f9b4013a120 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.767+0000 7f9b4804a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40139860 con 0x7f9b4013e950 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b45de6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9b40139d40 0x7f9b40097740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46546/0 (socket says 172.21.15.31:46546) 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b455e5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b4013a120 0x7f9b40096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b45de6700 1 -- 172.21.15.31:0/2527256621 learned_addr learned my addr 172.21.15.31:0/2527256621 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b465e7700 1 --2- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b44de4700 1 -- 172.21.15.31:0/2527256621 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310343529 0 0) 0x7f9b40097020 con 0x7f9b40139d40 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b465e7700 1 -- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b4013a120 msgr2=0x7f9b40096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b465e7700 1 --2- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b4013a120 0x7f9b40096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b465e7700 1 -- 172.21.15.31:0/2527256621 >> v1:172.21.15.31:6789/0 conn(0x7f9b40139d40 legacy=0x7f9b40097740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b465e7700 1 -- 172.21.15.31:0/2527256621 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40139b20 con 0x7f9b4013e950 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b455e5700 1 --2- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b4013a120 0x7f9b40096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b465e7700 1 --2- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40140d40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9b380032f0 tx=0x7f9b380091d0).ready entity=mon.2 client_cookie=a7938afc70c81b92 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b44de4700 1 -- 172.21.15.31:0/2527256621 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3800b6c0 con 0x7f9b4013e950 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b44de4700 1 -- 172.21.15.31:0/2527256621 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3800b820 con 0x7f9b4013e950 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.768+0000 7f9b44de4700 1 -- 172.21.15.31:0/2527256621 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b3800b990 con 0x7f9b4013e950 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.769+0000 7f9b4804a700 1 -- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 msgr2=0x7f9b40140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.769+0000 7f9b4804a700 1 --2- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40140d40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9b380032f0 tx=0x7f9b380091d0).stop 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.769+0000 7f9b4804a700 1 -- 172.21.15.31:0/2527256621 shutdown_connections 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.769+0000 7f9b4804a700 1 --2- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40140d40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.769+0000 7f9b4804a700 1 --2- 172.21.15.31:0/2527256621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b4013a120 0x7f9b40096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.769+0000 7f9b4804a700 1 -- 172.21.15.31:0/2527256621 >> 172.21.15.31:0/2527256621 conn(0x7f9b400613e0 msgr2=0x7f9b4006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.769+0000 7f9b4804a700 1 -- 172.21.15.31:0/2527256621 shutdown_connections 2024-04-26T07:28:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.769+0000 7f9b4804a700 1 -- 172.21.15.31:0/2527256621 wait complete. 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b4804a700 1 Processor -- start 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b4804a700 1 -- start start 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b4804a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b40139d40 0x7f9b40062680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b4804a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4013a120 0x7f9b40064f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b4804a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b4804a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40064650 con 0x7f9b4013a120 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b4804a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4013ced0 con 0x7f9b40139d40 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b4804a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40063160 con 0x7f9b4013e950 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b45de6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b40139d40 0x7f9b40062680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b45de6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b40139d40 0x7f9b40062680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39192/0 (socket says 172.21.15.31:39192) 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b465e7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b45de6700 1 -- 172.21.15.31:0/2246603223 learned_addr learned my addr 172.21.15.31:0/2246603223 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.770+0000 7f9b455e5700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4013a120 0x7f9b40064f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b455e5700 1 -- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 msgr2=0x7f9b40149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b455e5700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b455e5700 1 -- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b40139d40 msgr2=0x7f9b40062680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b455e5700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b40139d40 0x7f9b40062680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b455e5700 1 -- 172.21.15.31:0/2246603223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3000b180 con 0x7f9b4013a120 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b465e7700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b45de6700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b40139d40 0x7f9b40062680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b455e5700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4013a120 0x7f9b40064f30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9b3000c000 tx=0x7f9b30006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b2effd700 1 -- 172.21.15.31:0/2246603223 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b30010780 con 0x7f9b4013a120 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b2effd700 1 -- 172.21.15.31:0/2246603223 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b300108e0 con 0x7f9b4013a120 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b38009470 con 0x7f9b4013a120 2024-04-26T07:28:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b2effd700 1 -- 172.21.15.31:0/2246603223 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b30010c40 con 0x7f9b4013a120 2024-04-26T07:28:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.771+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b40062d80 con 0x7f9b4013a120 2024-04-26T07:28:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.772+0000 7f9b2effd700 1 -- 172.21.15.31:0/2246603223 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9b3001c460 con 0x7f9b4013a120 2024-04-26T07:28:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.772+0000 7f9b2effd700 1 -- 172.21.15.31:0/2246603223 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f9b3004a940 con 0x7f9b4013a120 2024-04-26T07:28:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.772+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b400a9f40 con 0x7f9b4013a120 2024-04-26T07:28:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.775+0000 7f9b2effd700 1 -- 172.21.15.31:0/2246603223 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9b300335c0 con 0x7f9b4013a120 2024-04-26T07:28:28.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:28.893+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9b4006bbc0 con 0x7f9b4013a120 2024-04-26T07:28:29.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.815+0000 7f9b2effd700 1 -- 172.21.15.31:0/2246603223 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9b3001c6f0 con 0x7f9b4013a120 2024-04-26T07:28:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 >> v1:172.21.15.31:6816/39613 conn(0x7f9b20038e30 legacy=0x7f9b2003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4013a120 msgr2=0x7f9b40064f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4013a120 0x7f9b40064f30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9b3000c000 tx=0x7f9b30006df0).stop 2024-04-26T07:28:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 shutdown_connections 2024-04-26T07:28:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9b4013e950 0x7f9b40149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9b40139d40 0x7f9b40062680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 --2- 172.21.15.31:0/2246603223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b4013a120 0x7f9b40064f30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 >> 172.21.15.31:0/2246603223 conn(0x7f9b400613e0 msgr2=0x7f9b4005c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:29.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 shutdown_connections 2024-04-26T07:28:29.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.818+0000 7f9b4804a700 1 -- 172.21.15.31:0/2246603223 wait complete. 2024-04-26T07:28:29.829 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-04-26T07:28:29.838 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T07:28:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.958+0000 7feefb213700 1 Processor -- start 2024-04-26T07:28:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.958+0000 7feefb213700 1 -- start start 2024-04-26T07:28:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feefb213700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef40a4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feefb213700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4066370 0x7feef4139f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feefb213700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feef4067370 0x7feef405bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feefb213700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef40678b0 con 0x7feef4067370 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feefb213700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef413a400 con 0x7feef4066370 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feefb213700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feef405e330 con 0x7feef4139b30 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4066370 0x7feef4139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef8faf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef40a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef97b0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feef4067370 0x7feef405bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4066370 0x7feef4139f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39196/0 (socket says 172.21.15.31:39196) 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef8faf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef40a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40396/0 (socket says 172.21.15.31:40396) 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 -- 172.21.15.31:0/3422170902 learned_addr learned my addr 172.21.15.31:0/3422170902 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 -- 172.21.15.31:0/3422170902 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 msgr2=0x7feef40a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 --2- 172.21.15.31:0/3422170902 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef40a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 -- 172.21.15.31:0/3422170902 >> v2:172.21.15.31:3300/0 conn(0x7feef4067370 msgr2=0x7feef405bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 --2- 172.21.15.31:0/3422170902 >> v2:172.21.15.31:3300/0 conn(0x7feef4067370 0x7feef405bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 -- 172.21.15.31:0/3422170902 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef405e4f0 con 0x7feef4066370 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef8faf700 1 --2- 172.21.15.31:0/3422170902 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef40a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef97b0700 1 --2- 172.21.15.31:0/3422170902 >> v2:172.21.15.31:3300/0 conn(0x7feef4067370 0x7feef405bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.959+0000 7feef3fff700 1 --2- 172.21.15.31:0/3422170902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4066370 0x7feef4139f10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7feee0002f70 tx=0x7feee0006eb0).ready entity=mon.1 client_cookie=f7040dc27a3a513c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feef37fe700 1 -- 172.21.15.31:0/3422170902 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee000d570 con 0x7feef4066370 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feef37fe700 1 -- 172.21.15.31:0/3422170902 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0000e90 con 0x7feef4066370 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feef37fe700 1 -- 172.21.15.31:0/3422170902 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee000d900 con 0x7feef4066370 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 -- 172.21.15.31:0/3422170902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4066370 msgr2=0x7feef4139f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 --2- 172.21.15.31:0/3422170902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4066370 0x7feef4139f10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7feee0002f70 tx=0x7feee0006eb0).stop 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 -- 172.21.15.31:0/3422170902 shutdown_connections 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 --2- 172.21.15.31:0/3422170902 >> v2:172.21.15.31:3300/0 conn(0x7feef4067370 0x7feef405bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 --2- 172.21.15.31:0/3422170902 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef40a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 --2- 172.21.15.31:0/3422170902 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4066370 0x7feef4139f10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 -- 172.21.15.31:0/3422170902 >> 172.21.15.31:0/3422170902 conn(0x7feef40a53d0 msgr2=0x7feef40a57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 -- 172.21.15.31:0/3422170902 shutdown_connections 2024-04-26T07:28:29.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.960+0000 7feefb213700 1 -- 172.21.15.31:0/3422170902 wait complete. 2024-04-26T07:28:29.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.961+0000 7feefb213700 1 Processor -- start 2024-04-26T07:28:29.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.961+0000 7feefb213700 1 -- start start 2024-04-26T07:28:29.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feefb213700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feef4066370 0x7feef4093a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feefb213700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4067370 0x7feef4149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feefb213700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef4149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feefb213700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef4093f10 con 0x7feef4066370 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feefb213700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef40a22a0 con 0x7feef4067370 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feefb213700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feef4094100 con 0x7feef4139b30 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4067370 0x7feef4149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef8faf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feef4066370 0x7feef4093a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef97b0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef4149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4067370 0x7feef4149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39210/0 (socket says 172.21.15.31:39210) 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef3fff700 1 -- 172.21.15.31:0/1981037194 learned_addr learned my addr 172.21.15.31:0/1981037194 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef8faf700 1 -- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 msgr2=0x7feef4149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef8faf700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef4149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef8faf700 1 -- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4067370 msgr2=0x7feef4149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef8faf700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4067370 0x7feef4149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef8faf700 1 -- 172.21.15.31:0/1981037194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009470 con 0x7feef4066370 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef97b0700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef4149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef3fff700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4067370 0x7feef4149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.962+0000 7feef8faf700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feef4066370 0x7feef4093a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feee800c000 tx=0x7feee8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.963+0000 7feef1ffb700 1 -- 172.21.15.31:0/1981037194 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee8010780 con 0x7feef4066370 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.963+0000 7feef1ffb700 1 -- 172.21.15.31:0/1981037194 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80108e0 con 0x7feef4066370 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.963+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee800b180 con 0x7feef4066370 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.963+0000 7feef1ffb700 1 -- 172.21.15.31:0/1981037194 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee8010c40 con 0x7feef4066370 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.963+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee000b1e0 con 0x7feef4066370 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.964+0000 7feef1ffb700 1 -- 172.21.15.31:0/1981037194 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7feee801c460 con 0x7feef4066370 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.964+0000 7feef1ffb700 1 -- 172.21.15.31:0/1981037194 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3192+0+0 (secure 0 0 0) 0x7feee804aba0 con 0x7feef4066370 2024-04-26T07:28:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.964+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef40a2460 con 0x7feef4066370 2024-04-26T07:28:29.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:29.967+0000 7feef1ffb700 1 -- 172.21.15.31:0/1981037194 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7feee8033610 con 0x7feef4066370 2024-04-26T07:28:30.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.084+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feef406bbc0 con 0x7feef4066370 2024-04-26T07:28:30.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.822+0000 7feef1ffb700 1 -- 172.21.15.31:0/1981037194 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v16) v1 ==== 170+0+0 (secure 0 0 0) 0x7feee80333e0 con 0x7feef4066370 2024-04-26T07:28:30.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.828+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 >> v1:172.21.15.31:6816/39613 conn(0x7feed4038da0 legacy=0x7feed403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.828+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feef4066370 msgr2=0x7feef4093a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.828+0000 7feefb213700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feef4066370 0x7feef4093a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feee800c000 tx=0x7feee8006df0).stop 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.828+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 shutdown_connections 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.828+0000 7feefb213700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feef4139b30 0x7feef4149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.828+0000 7feefb213700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feef4066370 0x7feef4093a20 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0x7feee800c000 tx=0x7feee8006df0).stop 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.828+0000 7feefb213700 1 --2- 172.21.15.31:0/1981037194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feef4067370 0x7feef4149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.828+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 >> 172.21.15.31:0/1981037194 conn(0x7feef40a53d0 msgr2=0x7feef40a8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.829+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 shutdown_connections 2024-04-26T07:28:30.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.829+0000 7feefb213700 1 -- 172.21.15.31:0/1981037194 wait complete. 2024-04-26T07:28:30.840 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-04-26T07:28:30.861 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T07:28:30.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.970+0000 7f211ea94700 1 Processor -- start 2024-04-26T07:28:30.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.970+0000 7f211ea94700 1 -- start start 2024-04-26T07:28:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211ea94700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118066e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211ea94700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f211805dfb0 0x7f211805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211ea94700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f211805c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211ea94700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211805c800 con 0x7f211805dfb0 2024-04-26T07:28:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211ea94700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2118066600 con 0x7f211805be60 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211ea94700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21180a4730 con 0x7f2118067d70 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f2117fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f211805dfb0 0x7f211805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211c830700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211d031700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f211805c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f2117fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f211805dfb0 0x7f211805b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36584/0 (socket says 172.21.15.31:36584) 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211d031700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f211805c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39218/0 (socket says 172.21.15.31:39218) 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f2117fff700 1 -- 172.21.15.31:0/395362391 learned_addr learned my addr 172.21.15.31:0/395362391 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211c830700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118066e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40408/0 (socket says 172.21.15.31:40408) 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211c830700 1 -- 172.21.15.31:0/395362391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 msgr2=0x7f211805c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211c830700 1 --2- 172.21.15.31:0/395362391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f211805c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211c830700 1 -- 172.21.15.31:0/395362391 >> v2:172.21.15.31:3300/0 conn(0x7f211805dfb0 msgr2=0x7f211805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.971+0000 7f211c830700 1 --2- 172.21.15.31:0/395362391 >> v2:172.21.15.31:3300/0 conn(0x7f211805dfb0 0x7f211805b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211c830700 1 -- 172.21.15.31:0/395362391 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180a49d0 con 0x7f2118067d70 2024-04-26T07:28:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f2117fff700 1 --2- 172.21.15.31:0/395362391 >> v2:172.21.15.31:3300/0 conn(0x7f211805dfb0 0x7f211805b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211d031700 1 --2- 172.21.15.31:0/395362391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f211805c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211c830700 1 --2- 172.21.15.31:0/395362391 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118066e70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f211805c940 tx=0x7f210c006df0).ready entity=mon.2 client_cookie=15580a12389ab865 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f21177fe700 1 -- 172.21.15.31:0/395362391 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210c00d570 con 0x7f2118067d70 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f21177fe700 1 -- 172.21.15.31:0/395362391 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c000e90 con 0x7f2118067d70 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f21177fe700 1 -- 172.21.15.31:0/395362391 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210c00d8c0 con 0x7f2118067d70 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 -- 172.21.15.31:0/395362391 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 msgr2=0x7f2118066e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 --2- 172.21.15.31:0/395362391 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118066e70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f211805c940 tx=0x7f210c006df0).stop 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 -- 172.21.15.31:0/395362391 shutdown_connections 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 --2- 172.21.15.31:0/395362391 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f211805c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 --2- 172.21.15.31:0/395362391 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118066e70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 --2- 172.21.15.31:0/395362391 >> v2:172.21.15.31:3300/0 conn(0x7f211805dfb0 0x7f211805b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 -- 172.21.15.31:0/395362391 >> 172.21.15.31:0/395362391 conn(0x7f2118060ee0 msgr2=0x7f21180a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 -- 172.21.15.31:0/395362391 shutdown_connections 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.972+0000 7f211ea94700 1 -- 172.21.15.31:0/395362391 wait complete. 2024-04-26T07:28:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.973+0000 7f211ea94700 1 Processor -- start 2024-04-26T07:28:30.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.973+0000 7f211ea94700 1 -- start start 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211ea94700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f2118092820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211ea94700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211805dfb0 0x7f21181325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211ea94700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118132ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211ea94700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118137490 con 0x7f211805dfb0 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211ea94700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2118132fa0 con 0x7f211805be60 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211ea94700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2118135db0 con 0x7f2118067d70 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211c830700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f2118092820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f2117fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211805dfb0 0x7f21181325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211d031700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118132ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211c830700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f2118092820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39226/0 (socket says 172.21.15.31:39226) 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f2117fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211805dfb0 0x7f21181325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36590/0 (socket says 172.21.15.31:36590) 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211d031700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118132ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40420/0 (socket says 172.21.15.31:40420) 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211c830700 1 -- 172.21.15.31:0/2843575579 learned_addr learned my addr 172.21.15.31:0/2843575579 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f2117fff700 1 -- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 msgr2=0x7f2118132ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f2117fff700 1 --2- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118132ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f2117fff700 1 -- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 msgr2=0x7f2118092820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f2117fff700 1 --2- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f2118092820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f2117fff700 1 -- 172.21.15.31:0/2843575579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110009470 con 0x7f211805dfb0 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.974+0000 7f211d031700 1 --2- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118132ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.975+0000 7f2117fff700 1 --2- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211805dfb0 0x7f21181325c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f210400c000 tx=0x7f2104006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.975+0000 7f2115ffb700 1 -- 172.21.15.31:0/2843575579 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2104012600 con 0x7f211805dfb0 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.975+0000 7f2115ffb700 1 -- 172.21.15.31:0/2843575579 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2104012760 con 0x7f211805dfb0 2024-04-26T07:28:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.975+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210400b1e0 con 0x7f211805dfb0 2024-04-26T07:28:30.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.975+0000 7f2115ffb700 1 -- 172.21.15.31:0/2843575579 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2104012ac0 con 0x7f211805dfb0 2024-04-26T07:28:30.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.975+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210c00b180 con 0x7f211805dfb0 2024-04-26T07:28:30.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.976+0000 7f2115ffb700 1 -- 172.21.15.31:0/2843575579 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2104022070 con 0x7f211805dfb0 2024-04-26T07:28:30.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.976+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2118092540 con 0x7f211805dfb0 2024-04-26T07:28:30.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.976+0000 7f2115ffb700 1 -- 172.21.15.31:0/2843575579 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3574+0+0 (secure 0 0 0) 0x7f210404acd0 con 0x7f211805dfb0 2024-04-26T07:28:30.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:30.979+0000 7f2115ffb700 1 -- 172.21.15.31:0/2843575579 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2118092540 con 0x7f211805dfb0 2024-04-26T07:28:31.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.129+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2118092540 con 0x7f211805dfb0 2024-04-26T07:28:31.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.139+0000 7f2115ffb700 1 -- 172.21.15.31:0/2843575579 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2118092540 con 0x7f211805dfb0 2024-04-26T07:28:31.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.153+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 >> v1:172.21.15.31:6816/39613 conn(0x7f20f8038da0 legacy=0x7f20f803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.153+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211805dfb0 msgr2=0x7f21181325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.153+0000 7f211ea94700 1 --2- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211805dfb0 0x7f21181325c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f210400c000 tx=0x7f2104006eb0).stop 2024-04-26T07:28:31.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.155+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 shutdown_connections 2024-04-26T07:28:31.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.155+0000 7f211ea94700 1 --2- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2118067d70 0x7f2118132ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.155+0000 7f211ea94700 1 --2- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f211805be60 0x7f2118092820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.155+0000 7f211ea94700 1 --2- 172.21.15.31:0/2843575579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211805dfb0 0x7f21181325c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.155+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 >> 172.21.15.31:0/2843575579 conn(0x7f2118060ee0 msgr2=0x7f2118139e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:31.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.156+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 shutdown_connections 2024-04-26T07:28:31.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.156+0000 7f211ea94700 1 -- 172.21.15.31:0/2843575579 wait complete. 2024-04-26T07:28:31.170 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T07:28:31.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.292+0000 7f90ff8ea700 1 Processor -- start 2024-04-26T07:28:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.292+0000 7f90ff8ea700 1 -- start start 2024-04-26T07:28:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90ff8ea700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90f80a22a0 0x7f90f809c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90ff8ea700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a3880 0x7f90f813e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90ff8ea700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f809d150 con 0x7f90f80a2680 2024-04-26T07:28:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90ff8ea700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f809dd80 con 0x7f90f80a22a0 2024-04-26T07:28:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90ff8ea700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90f809ce90 con 0x7f90f80a3880 2024-04-26T07:28:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fd686700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90f80a22a0 0x7f90f809c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fde87700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a3880 0x7f90f813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fde87700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a3880 0x7f90f813e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40426/0 (socket says 172.21.15.31:40426) 2024-04-26T07:28:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fce85700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f90f80a2680 0x7f90f80a3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46562/0 (socket says 172.21.15.31:46562) 2024-04-26T07:28:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fd686700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90f80a22a0 0x7f90f809c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36596/0 (socket says 172.21.15.31:36596) 2024-04-26T07:28:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fde87700 1 -- 172.21.15.31:0/3761513687 learned_addr learned my addr 172.21.15.31:0/3761513687 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fd686700 1 -- 172.21.15.31:0/3761513687 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a3880 msgr2=0x7f90f813e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fd686700 1 --2- 172.21.15.31:0/3761513687 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a3880 0x7f90f813e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fd686700 1 -- 172.21.15.31:0/3761513687 >> v1:172.21.15.31:6789/0 conn(0x7f90f80a2680 legacy=0x7f90f80a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90e7fff700 1 -- 172.21.15.31:0/3761513687 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780913190 0 0) 0x7f90f809d150 con 0x7f90f80a2680 2024-04-26T07:28:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fd686700 1 -- 172.21.15.31:0/3761513687 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f809e2d0 con 0x7f90f80a22a0 2024-04-26T07:28:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fde87700 1 --2- 172.21.15.31:0/3761513687 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a3880 0x7f90f813e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.293+0000 7f90fd686700 1 --2- 172.21.15.31:0/3761513687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f809c7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f90e8002f70 tx=0x7f90e8006e80).ready entity=mon.0 client_cookie=690f0e1c92945dbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90e7fff700 1 -- 172.21.15.31:0/3761513687 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90e800b7d0 con 0x7f90f80a22a0 2024-04-26T07:28:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90e7fff700 1 -- 172.21.15.31:0/3761513687 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e800b930 con 0x7f90f80a22a0 2024-04-26T07:28:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90e7fff700 1 -- 172.21.15.31:0/3761513687 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90e800bc90 con 0x7f90f80a22a0 2024-04-26T07:28:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90ff8ea700 1 -- 172.21.15.31:0/3761513687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 msgr2=0x7f90f809c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90ff8ea700 1 --2- 172.21.15.31:0/3761513687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f809c7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f90e8002f70 tx=0x7f90e8006e80).stop 2024-04-26T07:28:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90ff8ea700 1 -- 172.21.15.31:0/3761513687 shutdown_connections 2024-04-26T07:28:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90ff8ea700 1 --2- 172.21.15.31:0/3761513687 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a3880 0x7f90f813e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90ff8ea700 1 --2- 172.21.15.31:0/3761513687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f809c7d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90ff8ea700 1 -- 172.21.15.31:0/3761513687 >> 172.21.15.31:0/3761513687 conn(0x7f90f8060ee0 msgr2=0x7f90f80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90ff8ea700 1 -- 172.21.15.31:0/3761513687 shutdown_connections 2024-04-26T07:28:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.294+0000 7f90ff8ea700 1 -- 172.21.15.31:0/3761513687 wait complete. 2024-04-26T07:28:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.295+0000 7f90ff8ea700 1 Processor -- start 2024-04-26T07:28:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.295+0000 7f90ff8ea700 1 -- start start 2024-04-26T07:28:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90ff8ea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90ff8ea700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a2680 0x7f90f8064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90ff8ea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90f80a3880 0x7f90f81446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90ff8ea700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8065720 con 0x7f90f80a22a0 2024-04-26T07:28:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90ff8ea700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8063f70 con 0x7f90f80a3880 2024-04-26T07:28:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90ff8ea700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8065480 con 0x7f90f80a2680 2024-04-26T07:28:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fd686700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fd686700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f8067390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36598/0 (socket says 172.21.15.31:36598) 2024-04-26T07:28:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fd686700 1 -- 172.21.15.31:0/728852737 learned_addr learned my addr 172.21.15.31:0/728852737 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fce85700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a2680 0x7f90f8064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fde87700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90f80a3880 0x7f90f81446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fce85700 1 -- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90f80a3880 msgr2=0x7f90f81446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fce85700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90f80a3880 0x7f90f81446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fce85700 1 -- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 msgr2=0x7f90f8067390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.296+0000 7f90fce85700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f8067390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.297+0000 7f90fce85700 1 -- 172.21.15.31:0/728852737 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0009530 con 0x7f90f80a2680 2024-04-26T07:28:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.297+0000 7f90fd686700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f8067390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.297+0000 7f90fce85700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a2680 0x7f90f8064ab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f90f4000bc0 tx=0x7f90f40079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.297+0000 7f90e67fc700 1 -- 172.21.15.31:0/728852737 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f400cdd0 con 0x7f90f80a2680 2024-04-26T07:28:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.297+0000 7f90e67fc700 1 -- 172.21.15.31:0/728852737 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f40070d0 con 0x7f90f80a2680 2024-04-26T07:28:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.297+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e800d410 con 0x7f90f80a2680 2024-04-26T07:28:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.297+0000 7f90e67fc700 1 -- 172.21.15.31:0/728852737 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f4005550 con 0x7f90f80a2680 2024-04-26T07:28:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.297+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f809bf40 con 0x7f90f80a2680 2024-04-26T07:28:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.298+0000 7f90e67fc700 1 -- 172.21.15.31:0/728852737 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f90f401a060 con 0x7f90f80a2680 2024-04-26T07:28:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.298+0000 7f90e67fc700 1 -- 172.21.15.31:0/728852737 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f90f4049e60 con 0x7f90f80a2680 2024-04-26T07:28:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.298+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f806bbc0 con 0x7f90f80a2680 2024-04-26T07:28:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.301+0000 7f90e67fc700 1 -- 172.21.15.31:0/728852737 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f90f402ed60 con 0x7f90f80a2680 2024-04-26T07:28:31.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.418+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90f8135030 con 0x7f90f80a2680 2024-04-26T07:28:31.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.419+0000 7f90e67fc700 1 -- 172.21.15.31:0/728852737 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+10545 (secure 0 0 0) 0x7f90f4022070 con 0x7f90f80a2680 2024-04-26T07:28:31.420 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:31.420 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:31.131432+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 >> v1:172.21.15.31:6816/39613 conn(0x7f90d8038dd0 legacy=0x7f90d803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a2680 msgr2=0x7f90f8064ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a2680 0x7f90f8064ab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f90f4000bc0 tx=0x7f90f40079e0).stop 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 shutdown_connections 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90f80a3880 0x7f90f81446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f80a22a0 0x7f90f8067390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 --2- 172.21.15.31:0/728852737 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f90f80a2680 0x7f90f8064ab0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 >> 172.21.15.31:0/728852737 conn(0x7f90f8060ee0 msgr2=0x7f90f81369c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 shutdown_connections 2024-04-26T07:28:31.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.420+0000 7f90ff8ea700 1 -- 172.21.15.31:0/728852737 wait complete. 2024-04-26T07:28:31.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.537+0000 7fda25749700 1 Processor -- start 2024-04-26T07:28:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.537+0000 7fda25749700 1 -- start start 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda25749700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda2006c7d0 0x7fda201360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda25749700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fda20096320 0x7fda2005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda25749700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda2005c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda25749700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda20133c10 con 0x7fda20096320 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda25749700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2005c800 con 0x7fda2006c7d0 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda25749700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda200970a0 con 0x7fda2005be60 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda1f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda2005c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda1effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda2006c7d0 0x7fda201360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda1e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fda20096320 0x7fda2005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda1f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda2005c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40438/0 (socket says 172.21.15.31:40438) 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda1effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda2006c7d0 0x7fda201360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39246/0 (socket says 172.21.15.31:39246) 2024-04-26T07:28:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda1e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fda20096320 0x7fda2005b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36610/0 (socket says 172.21.15.31:36610) 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.538+0000 7fda1f7fe700 1 -- 172.21.15.31:0/3229115308 learned_addr learned my addr 172.21.15.31:0/3229115308 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1f7fe700 1 -- 172.21.15.31:0/3229115308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda2006c7d0 msgr2=0x7fda201360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1f7fe700 1 --2- 172.21.15.31:0/3229115308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda2006c7d0 0x7fda201360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1f7fe700 1 -- 172.21.15.31:0/3229115308 >> v2:172.21.15.31:3300/0 conn(0x7fda20096320 msgr2=0x7fda2005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1f7fe700 1 --2- 172.21.15.31:0/3229115308 >> v2:172.21.15.31:3300/0 conn(0x7fda20096320 0x7fda2005b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1f7fe700 1 -- 172.21.15.31:0/3229115308 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20136780 con 0x7fda2005be60 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1e7fc700 1 --2- 172.21.15.31:0/3229115308 >> v2:172.21.15.31:3300/0 conn(0x7fda20096320 0x7fda2005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1f7fe700 1 --2- 172.21.15.31:0/3229115308 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda2005c310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fda180032f0 tx=0x7fda18009290).ready entity=mon.2 client_cookie=5f007577323f8317 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1dffb700 1 -- 172.21.15.31:0/3229115308 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1800b660 con 0x7fda2005be60 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1dffb700 1 -- 172.21.15.31:0/3229115308 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800b7c0 con 0x7fda2005be60 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda1dffb700 1 -- 172.21.15.31:0/3229115308 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1800b930 con 0x7fda2005be60 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 -- 172.21.15.31:0/3229115308 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 msgr2=0x7fda2005c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 --2- 172.21.15.31:0/3229115308 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda2005c310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fda180032f0 tx=0x7fda18009290).stop 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 -- 172.21.15.31:0/3229115308 shutdown_connections 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 --2- 172.21.15.31:0/3229115308 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda2005c310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 --2- 172.21.15.31:0/3229115308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda2006c7d0 0x7fda201360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 --2- 172.21.15.31:0/3229115308 >> v2:172.21.15.31:3300/0 conn(0x7fda20096320 0x7fda2005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 -- 172.21.15.31:0/3229115308 >> 172.21.15.31:0/3229115308 conn(0x7fda20061370 msgr2=0x7fda2006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 -- 172.21.15.31:0/3229115308 shutdown_connections 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.539+0000 7fda25749700 1 -- 172.21.15.31:0/3229115308 wait complete. 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.540+0000 7fda25749700 1 Processor -- start 2024-04-26T07:28:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.540+0000 7fda25749700 1 -- start start 2024-04-26T07:28:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda25749700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda20149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda25749700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda2006c7d0 0x7fda20067010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda25749700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda20096320 0x7fda20067500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda25749700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200657f0 con 0x7fda2006c7d0 2024-04-26T07:28:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda25749700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2009cf50 con 0x7fda20096320 2024-04-26T07:28:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda25749700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda201496f0 con 0x7fda2005be60 2024-04-26T07:28:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda20149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda20096320 0x7fda20067500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda20149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40440/0 (socket says 172.21.15.31:40440) 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 -- 172.21.15.31:0/3437763898 learned_addr learned my addr 172.21.15.31:0/3437763898 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1f7fe700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda20096320 0x7fda20067500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39262/0 (socket says 172.21.15.31:39262) 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1e7fc700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda2006c7d0 0x7fda20067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 -- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda20096320 msgr2=0x7fda20067500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda20096320 0x7fda20067500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 -- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda2006c7d0 msgr2=0x7fda20067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda2006c7d0 0x7fda20067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 -- 172.21.15.31:0/3437763898 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1000b180 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1e7fc700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda2006c7d0 0x7fda20067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.541+0000 7fda1effd700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda20149b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fda1400c000 tx=0x7fda14006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.542+0000 7fda0ffff700 1 -- 172.21.15.31:0/3437763898 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda14010780 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.542+0000 7fda0ffff700 1 -- 172.21.15.31:0/3437763898 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda140108e0 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.542+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda18009530 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.542+0000 7fda0ffff700 1 -- 172.21.15.31:0/3437763898 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda14010c40 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.542+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2005c440 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.542+0000 7fda0ffff700 1 -- 172.21.15.31:0/3437763898 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fda1401c460 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.543+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda200a6b00 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.543+0000 7fda0ffff700 1 -- 172.21.15.31:0/3437763898 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fda1404aba0 con 0x7fda2005be60 2024-04-26T07:28:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.546+0000 7fda0ffff700 1 -- 172.21.15.31:0/3437763898 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fda200a6b00 con 0x7fda2005be60 2024-04-26T07:28:31.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.663+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda20066af0 con 0x7fda2005be60 2024-04-26T07:28:31.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.663+0000 7fda0ffff700 1 -- 172.21.15.31:0/3437763898 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+10545 (secure 0 0 0) 0x7fda140334d0 con 0x7fda2005be60 2024-04-26T07:28:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:31.665 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:31.131432+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 >> v1:172.21.15.31:6816/39613 conn(0x7fd9fc038dd0 legacy=0x7fd9fc03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 msgr2=0x7fda20149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda20149b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fda1400c000 tx=0x7fda14006df0).stop 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 shutdown_connections 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda2005be60 0x7fda20149b80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda20096320 0x7fda20067500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 --2- 172.21.15.31:0/3437763898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda2006c7d0 0x7fda20067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 >> 172.21.15.31:0/3437763898 conn(0x7fda20061370 msgr2=0x7fda200989a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:31.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 shutdown_connections 2024-04-26T07:28:31.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.665+0000 7fda25749700 1 -- 172.21.15.31:0/3437763898 wait complete. 2024-04-26T07:28:31.677 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T07:28:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.784+0000 7f8e5575e700 1 Processor -- start 2024-04-26T07:28:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.784+0000 7f8e5575e700 1 -- start start 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e5575e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e5006c990 0x7f8e50136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e5575e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50136c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e5575e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5006cd70 con 0x7f8e50133340 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e5575e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e50132eb0 con 0x7f8e5006c990 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e5575e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50063c00 con 0x7f8e500648b0 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e5006c990 0x7f8e50136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50136c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39264/0 (socket says 172.21.15.31:39264) 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e5006c990 0x7f8e50136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36630/0 (socket says 172.21.15.31:36630) 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8e50133340 0x7f8e501337a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46566/0 (socket says 172.21.15.31:46566) 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4e7fc700 1 -- 172.21.15.31:0/273132505 learned_addr learned my addr 172.21.15.31:0/273132505 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4effd700 1 -- 172.21.15.31:0/273132505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 msgr2=0x7f8e50136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4effd700 1 --2- 172.21.15.31:0/273132505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50136c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.785+0000 7f8e4effd700 1 -- 172.21.15.31:0/273132505 >> v1:172.21.15.31:6789/0 conn(0x7f8e50133340 legacy=0x7f8e501337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e4dffb700 1 -- 172.21.15.31:0/273132505 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682022892 0 0) 0x7f8e5006cd70 con 0x7f8e50133340 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e4effd700 1 -- 172.21.15.31:0/273132505 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e501330a0 con 0x7f8e5006c990 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e4effd700 1 --2- 172.21.15.31:0/273132505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 0x7f8e50136400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8e44002f70 tx=0x7f8e44006df0).ready entity=mon.0 client_cookie=e6238df6b7f1f83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e4dffb700 1 -- 172.21.15.31:0/273132505 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e4400d570 con 0x7f8e5006c990 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e4dffb700 1 -- 172.21.15.31:0/273132505 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44000e90 con 0x7f8e5006c990 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e4dffb700 1 -- 172.21.15.31:0/273132505 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e4400d8c0 con 0x7f8e5006c990 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e5575e700 1 -- 172.21.15.31:0/273132505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 msgr2=0x7f8e50136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e5575e700 1 --2- 172.21.15.31:0/273132505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 0x7f8e50136400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8e44002f70 tx=0x7f8e44006df0).stop 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e5575e700 1 -- 172.21.15.31:0/273132505 shutdown_connections 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e5575e700 1 --2- 172.21.15.31:0/273132505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 0x7f8e50136400 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e5575e700 1 --2- 172.21.15.31:0/273132505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50136c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e5575e700 1 -- 172.21.15.31:0/273132505 >> 172.21.15.31:0/273132505 conn(0x7f8e50061370 msgr2=0x7f8e5006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e5575e700 1 -- 172.21.15.31:0/273132505 shutdown_connections 2024-04-26T07:28:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.786+0000 7f8e5575e700 1 -- 172.21.15.31:0/273132505 wait complete. 2024-04-26T07:28:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.787+0000 7f8e5575e700 1 Processor -- start 2024-04-26T07:28:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.787+0000 7f8e5575e700 1 -- start start 2024-04-26T07:28:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e5575e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50092160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e5575e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 0x7f8e50067200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e5575e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e50133340 0x7f8e50065090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e5575e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50136080 con 0x7f8e5006c990 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e5575e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50098720 con 0x7f8e500648b0 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e5575e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50130bc0 con 0x7f8e50133340 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50092160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 0x7f8e50067200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50092160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39266/0 (socket says 172.21.15.31:39266) 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4effd700 1 -- 172.21.15.31:0/1426863121 learned_addr learned my addr 172.21.15.31:0/1426863121 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4f7fe700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e50133340 0x7f8e50065090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4effd700 1 -- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e50133340 msgr2=0x7f8e50065090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4effd700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e50133340 0x7f8e50065090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4effd700 1 -- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 msgr2=0x7f8e50067200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4effd700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 0x7f8e50067200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4effd700 1 -- 172.21.15.31:0/1426863121 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4400b180 con 0x7f8e500648b0 2024-04-26T07:28:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.788+0000 7f8e4e7fc700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 0x7f8e50067200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.789+0000 7f8e4effd700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50092160 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8e44002f70 tx=0x7f8e44014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.789+0000 7f8e3ffff700 1 -- 172.21.15.31:0/1426863121 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e44013e90 con 0x7f8e500648b0 2024-04-26T07:28:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.789+0000 7f8e3ffff700 1 -- 172.21.15.31:0/1426863121 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4401e400 con 0x7f8e500648b0 2024-04-26T07:28:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.789+0000 7f8e3ffff700 1 -- 172.21.15.31:0/1426863121 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e4401e760 con 0x7f8e500648b0 2024-04-26T07:28:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.789+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e50092b70 con 0x7f8e500648b0 2024-04-26T07:28:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.789+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e50093960 con 0x7f8e500648b0 2024-04-26T07:28:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.790+0000 7f8e3ffff700 1 -- 172.21.15.31:0/1426863121 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8e44025030 con 0x7f8e500648b0 2024-04-26T07:28:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.790+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5006bbc0 con 0x7f8e500648b0 2024-04-26T07:28:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.790+0000 7f8e3ffff700 1 -- 172.21.15.31:0/1426863121 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8e4404b660 con 0x7f8e500648b0 2024-04-26T07:28:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.793+0000 7f8e3ffff700 1 -- 172.21.15.31:0/1426863121 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8e44020200 con 0x7f8e500648b0 2024-04-26T07:28:31.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:31.949+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8e50064dd0 con 0x7f8e500648b0 2024-04-26T07:28:32.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.827+0000 7f8e3ffff700 1 -- 172.21.15.31:0/1426863121 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8e44023030 con 0x7f8e500648b0 2024-04-26T07:28:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 >> v1:172.21.15.31:6816/39613 conn(0x7f8e2c038f80 legacy=0x7f8e2c03b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 msgr2=0x7f8e50092160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50092160 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8e44002f70 tx=0x7f8e44014000).stop 2024-04-26T07:28:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 shutdown_connections 2024-04-26T07:28:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e50133340 0x7f8e50065090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e500648b0 0x7f8e50092160 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 --2- 172.21.15.31:0/1426863121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e5006c990 0x7f8e50067200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 >> 172.21.15.31:0/1426863121 conn(0x7f8e50061370 msgr2=0x7f8e50132700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 shutdown_connections 2024-04-26T07:28:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.829+0000 7f8e5575e700 1 -- 172.21.15.31:0/1426863121 wait complete. 2024-04-26T07:28:32.843 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 2} 2024-04-26T07:28:32.843 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-04-26T07:28:32.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.959+0000 7f6a41343700 1 Processor -- start 2024-04-26T07:28:32.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.959+0000 7f6a41343700 1 -- start start 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.959+0000 7f6a41343700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0a8af0 0x7f6a3c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.959+0000 7f6a41343700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.959+0000 7f6a41343700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c05b970 con 0x7f6a3c0aca60 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.959+0000 7f6a41343700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c05c3d0 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.959+0000 7f6a41343700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c05d300 con 0x7f6a3c0a8af0 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3affd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6a3c0aca60 0x7f6a3c139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46570/0 (socket says 172.21.15.31:46570) 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3affd700 1 -- 172.21.15.31:0/1717818655 learned_addr learned my addr 172.21.15.31:0/1717818655 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:32.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3a7fc700 1 --2- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0a8af0 0x7f6a3c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3b7fe700 1 -- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0a8af0 msgr2=0x7f6a3c0ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3b7fe700 1 --2- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0a8af0 0x7f6a3c0ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3b7fe700 1 -- 172.21.15.31:0/1717818655 >> v1:172.21.15.31:6789/0 conn(0x7f6a3c0aca60 legacy=0x7f6a3c139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a39ffb700 1 -- 172.21.15.31:0/1717818655 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545155345 0 0) 0x7f6a3c05b970 con 0x7f6a3c0aca60 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3b7fe700 1 -- 172.21.15.31:0/1717818655 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0ac400 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3a7fc700 1 --2- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0a8af0 0x7f6a3c0ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a3b7fe700 1 --2- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c139c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6a340032f0 tx=0x7f6a340091d0).ready entity=mon.1 client_cookie=ef9ece9707a2c493 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a39ffb700 1 -- 172.21.15.31:0/1717818655 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a3400b6c0 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a39ffb700 1 -- 172.21.15.31:0/1717818655 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400b820 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.960+0000 7f6a39ffb700 1 -- 172.21.15.31:0/1717818655 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a3400b990 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.961+0000 7f6a41343700 1 -- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 msgr2=0x7f6a3c139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.961+0000 7f6a41343700 1 --2- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c139c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6a340032f0 tx=0x7f6a340091d0).stop 2024-04-26T07:28:32.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.961+0000 7f6a41343700 1 -- 172.21.15.31:0/1717818655 shutdown_connections 2024-04-26T07:28:32.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.961+0000 7f6a41343700 1 --2- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c139c20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:32.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.961+0000 7f6a41343700 1 --2- 172.21.15.31:0/1717818655 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0a8af0 0x7f6a3c0ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:32.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.961+0000 7f6a41343700 1 -- 172.21.15.31:0/1717818655 >> 172.21.15.31:0/1717818655 conn(0x7f6a3c066d50 msgr2=0x7f6a3c067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:32.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.961+0000 7f6a41343700 1 -- 172.21.15.31:0/1717818655 shutdown_connections 2024-04-26T07:28:32.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.961+0000 7f6a41343700 1 -- 172.21.15.31:0/1717818655 wait complete. 2024-04-26T07:28:32.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a41343700 1 Processor -- start 2024-04-26T07:28:32.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a41343700 1 -- start start 2024-04-26T07:28:32.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a41343700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c1198d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a41343700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a3c0a8af0 0x7f6a3c148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a41343700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0aca60 0x7f6a3c1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a41343700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c1172d0 con 0x7f6a3c0a8af0 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a41343700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c117590 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a41343700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c13a100 con 0x7f6a3c0aca60 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.962+0000 7f6a3affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c1198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0aca60 0x7f6a3c1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c1198d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39280/0 (socket says 172.21.15.31:39280) 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3affd700 1 -- 172.21.15.31:0/1563068321 learned_addr learned my addr 172.21.15.31:0/1563068321 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a3c0a8af0 0x7f6a3c148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3affd700 1 -- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0aca60 msgr2=0x7f6a3c1491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:32.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3affd700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0aca60 0x7f6a3c1491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3affd700 1 -- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a3c0a8af0 msgr2=0x7f6a3c148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3affd700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a3c0a8af0 0x7f6a3c148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3affd700 1 -- 172.21.15.31:0/1563068321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3000b180 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3b7fe700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0aca60 0x7f6a3c1491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3a7fc700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a3c0a8af0 0x7f6a3c148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a3affd700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c1198d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6a2c000bc0 tx=0x7f6a2c007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a2bfff700 1 -- 172.21.15.31:0/1563068321 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a2c00ce00 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a2bfff700 1 -- 172.21.15.31:0/1563068321 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0070d0 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a34009470 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a2bfff700 1 -- 172.21.15.31:0/1563068321 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a2c007430 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.963+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c116f20 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.964+0000 7f6a2bfff700 1 -- 172.21.15.31:0/1563068321 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6a2c01a060 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.964+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c1195f0 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.964+0000 7f6a2bfff700 1 -- 172.21.15.31:0/1563068321 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6a2c049c50 con 0x7f6a3c05cbb0 2024-04-26T07:28:32.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:32.967+0000 7f6a2bfff700 1 -- 172.21.15.31:0/1563068321 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6a3c1195f0 con 0x7f6a3c05cbb0 2024-04-26T07:28:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.117+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f6a3c1168f0 con 0x7f6a3c05cbb0 2024-04-26T07:28:33.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.831+0000 7f6a2bfff700 1 -- 172.21.15.31:0/1563068321 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f6a3c1168f0 con 0x7f6a3c05cbb0 2024-04-26T07:28:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.835+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 >> v1:172.21.15.31:6816/39613 conn(0x7f6a18038e30 legacy=0x7f6a1803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.835+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 msgr2=0x7f6a3c1198d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.835+0000 7f6a41343700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c1198d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6a2c000bc0 tx=0x7f6a2c007c90).stop 2024-04-26T07:28:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.836+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 shutdown_connections 2024-04-26T07:28:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.836+0000 7f6a41343700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a3c0aca60 0x7f6a3c1491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.836+0000 7f6a41343700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a3c05cbb0 0x7f6a3c1198d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.836+0000 7f6a41343700 1 --2- 172.21.15.31:0/1563068321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a3c0a8af0 0x7f6a3c148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.836+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 >> 172.21.15.31:0/1563068321 conn(0x7f6a3c066d50 msgr2=0x7f6a3c137b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:33.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.836+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 shutdown_connections 2024-04-26T07:28:33.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.836+0000 7f6a41343700 1 -- 172.21.15.31:0/1563068321 wait complete. 2024-04-26T07:28:33.855 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T07:28:33.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.968+0000 7fae1387b700 1 Processor -- start 2024-04-26T07:28:33.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae1387b700 1 -- start start 2024-04-26T07:28:33.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae1387b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c0648b0 0x7fae0c136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:33.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae1387b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae0c133340 0x7fae0c1337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:33.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae1387b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c06cd70 con 0x7fae0c06c990 2024-04-26T07:28:33.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae1387b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c137340 con 0x7fae0c133340 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae1387b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c132eb0 con 0x7fae0c0648b0 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae11e18700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae0c133340 0x7fae0c1337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae10e16700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c0648b0 0x7fae0c136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae11e18700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae0c133340 0x7fae0c1337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36660/0 (socket says 172.21.15.31:36660) 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae10e16700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c0648b0 0x7fae0c136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40468/0 (socket says 172.21.15.31:40468) 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae11617700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fae0c06c990 0x7fae0c136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46574/0 (socket says 172.21.15.31:46574) 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.969+0000 7fae11e18700 1 -- 172.21.15.31:0/2515129243 learned_addr learned my addr 172.21.15.31:0/2515129243 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae10e16700 1 -- 172.21.15.31:0/2515129243 >> v2:172.21.15.31:3300/0 conn(0x7fae0c133340 msgr2=0x7fae0c1337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae10e16700 1 --2- 172.21.15.31:0/2515129243 >> v2:172.21.15.31:3300/0 conn(0x7fae0c133340 0x7fae0c1337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae10e16700 1 -- 172.21.15.31:0/2515129243 >> v1:172.21.15.31:6789/0 conn(0x7fae0c06c990 legacy=0x7fae0c136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae10e16700 1 -- 172.21.15.31:0/2515129243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c063c00 con 0x7fae0c0648b0 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae11e18700 1 --2- 172.21.15.31:0/2515129243 >> v2:172.21.15.31:3300/0 conn(0x7fae0c133340 0x7fae0c1337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:33.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae10e16700 1 --2- 172.21.15.31:0/2515129243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c0648b0 0x7fae0c136400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fae0c0a9bc0 tx=0x7fae08006df0).ready entity=mon.2 client_cookie=1018affe49326d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:33.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fadfbfff700 1 -- 172.21.15.31:0/2515129243 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae0800d570 con 0x7fae0c0648b0 2024-04-26T07:28:33.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fadfbfff700 1 -- 172.21.15.31:0/2515129243 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08000e90 con 0x7fae0c0648b0 2024-04-26T07:28:33.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fadfbfff700 1 -- 172.21.15.31:0/2515129243 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae0800d8c0 con 0x7fae0c0648b0 2024-04-26T07:28:33.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae1387b700 1 -- 172.21.15.31:0/2515129243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c0648b0 msgr2=0x7fae0c136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:33.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae1387b700 1 --2- 172.21.15.31:0/2515129243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c0648b0 0x7fae0c136400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fae0c0a9bc0 tx=0x7fae08006df0).stop 2024-04-26T07:28:33.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae1387b700 1 -- 172.21.15.31:0/2515129243 shutdown_connections 2024-04-26T07:28:33.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae1387b700 1 --2- 172.21.15.31:0/2515129243 >> v2:172.21.15.31:3300/0 conn(0x7fae0c133340 0x7fae0c1337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae1387b700 1 --2- 172.21.15.31:0/2515129243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c0648b0 0x7fae0c136400 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.970+0000 7fae1387b700 1 -- 172.21.15.31:0/2515129243 >> 172.21.15.31:0/2515129243 conn(0x7fae0c061370 msgr2=0x7fae0c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.971+0000 7fae1387b700 1 -- 172.21.15.31:0/2515129243 shutdown_connections 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.971+0000 7fae1387b700 1 -- 172.21.15.31:0/2515129243 wait complete. 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.971+0000 7fae1387b700 1 Processor -- start 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.971+0000 7fae1387b700 1 -- start start 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae1387b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae0c0648b0 0x7fae0c13ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae1387b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae0c06c990 0x7fae0c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae1387b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c133340 0x7fae0c1466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae1387b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c13d160 con 0x7fae0c06c990 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae1387b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c13bb40 con 0x7fae0c0648b0 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae1387b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c13b740 con 0x7fae0c133340 2024-04-26T07:28:33.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae10e16700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae0c06c990 0x7fae0c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11e18700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c133340 0x7fae0c1466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11617700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae0c0648b0 0x7fae0c13ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11e18700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c133340 0x7fae0c1466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40482/0 (socket says 172.21.15.31:40482) 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae10e16700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae0c06c990 0x7fae0c1461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36662/0 (socket says 172.21.15.31:36662) 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11e18700 1 -- 172.21.15.31:0/2044192170 learned_addr learned my addr 172.21.15.31:0/2044192170 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11e18700 1 -- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae0c0648b0 msgr2=0x7fae0c13ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11e18700 1 --2- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae0c0648b0 0x7fae0c13ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11e18700 1 -- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae0c06c990 msgr2=0x7fae0c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11e18700 1 --2- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae0c06c990 0x7fae0c1461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae11e18700 1 -- 172.21.15.31:0/2044192170 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04009530 con 0x7fae0c133340 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.972+0000 7fae10e16700 1 --2- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae0c06c990 0x7fae0c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.973+0000 7fae11e18700 1 --2- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c133340 0x7fae0c1466c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fae04006ec0 tx=0x7fae04009290).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:33.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.973+0000 7fadfa7fc700 1 -- 172.21.15.31:0/2044192170 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae0400c850 con 0x7fae0c133340 2024-04-26T07:28:33.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.973+0000 7fadfa7fc700 1 -- 172.21.15.31:0/2044192170 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0400c9b0 con 0x7fae0c133340 2024-04-26T07:28:33.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.973+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0800b180 con 0x7fae0c133340 2024-04-26T07:28:33.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.973+0000 7fadfa7fc700 1 -- 172.21.15.31:0/2044192170 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae0400cd10 con 0x7fae0c133340 2024-04-26T07:28:33.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.973+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c145ee0 con 0x7fae0c133340 2024-04-26T07:28:33.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.974+0000 7fadfa7fc700 1 -- 172.21.15.31:0/2044192170 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fae04022070 con 0x7fae0c133340 2024-04-26T07:28:33.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.974+0000 7fadfa7fc700 1 -- 172.21.15.31:0/2044192170 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fae0404b050 con 0x7fae0c133340 2024-04-26T07:28:33.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.974+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c13d300 con 0x7fae0c133340 2024-04-26T07:28:33.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:33.977+0000 7fadfa7fc700 1 -- 172.21.15.31:0/2044192170 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fae0c13d300 con 0x7fae0c133340 2024-04-26T07:28:34.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.126+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fae0c13d300 con 0x7fae0c133340 2024-04-26T07:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.839+0000 7fadfa7fc700 1 -- 172.21.15.31:0/2044192170 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fae0c13d300 con 0x7fae0c133340 2024-04-26T07:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 >> v1:172.21.15.31:6816/39613 conn(0x7fadec038f50 legacy=0x7fadec03b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c133340 msgr2=0x7fae0c1466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 --2- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c133340 0x7fae0c1466c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fae04006ec0 tx=0x7fae04009290).stop 2024-04-26T07:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 shutdown_connections 2024-04-26T07:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 --2- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae0c133340 0x7fae0c1466c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 --2- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae0c0648b0 0x7fae0c13ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 --2- 172.21.15.31:0/2044192170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae0c06c990 0x7fae0c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 >> 172.21.15.31:0/2044192170 conn(0x7fae0c061370 msgr2=0x7fae0c131820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 shutdown_connections 2024-04-26T07:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.841+0000 7fae1387b700 1 -- 172.21.15.31:0/2044192170 wait complete. 2024-04-26T07:28:34.855 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T07:28:34.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.968+0000 7f22345ac700 1 Processor -- start 2024-04-26T07:28:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.968+0000 7f22345ac700 1 -- start start 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.968+0000 7f22345ac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1335d0 0x7f222c0679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.968+0000 7f22345ac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f222c1339b0 0x7f222c0a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.968+0000 7f22345ac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c067ec0 con 0x7f222c05b970 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.968+0000 7f22345ac700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c0670c0 con 0x7f222c1339b0 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.968+0000 7f22345ac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f222c066600 con 0x7f222c1335d0 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2232348700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1335d0 0x7f222c0679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231b47700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f222c1339b0 0x7f222c0a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2232348700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1335d0 0x7f222c0679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40490/0 (socket says 172.21.15.31:40490) 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2232b49700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f222c05b970 0x7f222c05be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46580/0 (socket says 172.21.15.31:46580) 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2232348700 1 -- 172.21.15.31:0/4036192851 learned_addr learned my addr 172.21.15.31:0/4036192851 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231b47700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f222c1339b0 0x7f222c0a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36672/0 (socket says 172.21.15.31:36672) 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231b47700 1 -- 172.21.15.31:0/4036192851 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1335d0 msgr2=0x7f222c0679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231b47700 1 --2- 172.21.15.31:0/4036192851 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1335d0 0x7f222c0679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231b47700 1 -- 172.21.15.31:0/4036192851 >> v1:172.21.15.31:6789/0 conn(0x7f222c05b970 legacy=0x7f222c05be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231b47700 1 -- 172.21.15.31:0/4036192851 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c066de0 con 0x7f222c1339b0 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231346700 1 -- 172.21.15.31:0/4036192851 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654487259 0 0) 0x7f222c067ec0 con 0x7f222c05b970 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2232348700 1 --2- 172.21.15.31:0/4036192851 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1335d0 0x7f222c0679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231b47700 1 --2- 172.21.15.31:0/4036192851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c1339b0 0x7f222c0a43e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f221c002f70 tx=0x7f221c006df0).ready entity=mon.0 client_cookie=e289c5317bbf0f51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231346700 1 -- 172.21.15.31:0/4036192851 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221c00d570 con 0x7f222c1339b0 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231346700 1 -- 172.21.15.31:0/4036192851 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c000e90 con 0x7f222c1339b0 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.969+0000 7f2231346700 1 -- 172.21.15.31:0/4036192851 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221c00d8c0 con 0x7f222c1339b0 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.970+0000 7f22345ac700 1 -- 172.21.15.31:0/4036192851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c1339b0 msgr2=0x7f222c0a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:34.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.970+0000 7f22345ac700 1 --2- 172.21.15.31:0/4036192851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c1339b0 0x7f222c0a43e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f221c002f70 tx=0x7f221c006df0).stop 2024-04-26T07:28:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.970+0000 7f22345ac700 1 -- 172.21.15.31:0/4036192851 shutdown_connections 2024-04-26T07:28:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.970+0000 7f22345ac700 1 --2- 172.21.15.31:0/4036192851 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1335d0 0x7f222c0679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.970+0000 7f22345ac700 1 --2- 172.21.15.31:0/4036192851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c1339b0 0x7f222c0a43e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.970+0000 7f22345ac700 1 -- 172.21.15.31:0/4036192851 >> 172.21.15.31:0/4036192851 conn(0x7f222c060ee0 msgr2=0x7f222c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.970+0000 7f22345ac700 1 -- 172.21.15.31:0/4036192851 shutdown_connections 2024-04-26T07:28:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.970+0000 7f22345ac700 1 -- 172.21.15.31:0/4036192851 wait complete. 2024-04-26T07:28:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f22345ac700 1 Processor -- start 2024-04-26T07:28:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f22345ac700 1 -- start start 2024-04-26T07:28:34.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f22345ac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c05b970 0x7f222c149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:34.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f22345ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f222c1335d0 0x7f222c130440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f22345ac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1339b0 0x7f222c130930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f22345ac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c1357d0 con 0x7f222c05b970 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f22345ac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c1366e0 con 0x7f222c1335d0 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f22345ac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f222c149920 con 0x7f222c1339b0 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f2232348700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c05b970 0x7f222c149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f2232b49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1339b0 0x7f222c130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f2232348700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c05b970 0x7f222c149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36676/0 (socket says 172.21.15.31:36676) 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.971+0000 7f2232348700 1 -- 172.21.15.31:0/2812100201 learned_addr learned my addr 172.21.15.31:0/2812100201 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f2231b47700 1 --2- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f222c1335d0 0x7f222c130440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f2232348700 1 -- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1339b0 msgr2=0x7f222c130930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f2232348700 1 --2- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1339b0 0x7f222c130930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f2232348700 1 -- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f222c1335d0 msgr2=0x7f222c130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f2232348700 1 --2- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f222c1335d0 0x7f222c130440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f2232348700 1 -- 172.21.15.31:0/2812100201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222800b1e0 con 0x7f222c05b970 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f2232348700 1 --2- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c05b970 0x7f222c149180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f222800c000 tx=0x7f2228006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f221b7fe700 1 -- 172.21.15.31:0/2812100201 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2228012600 con 0x7f222c05b970 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f221b7fe700 1 -- 172.21.15.31:0/2812100201 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2228012760 con 0x7f222c05b970 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c00b180 con 0x7f222c05b970 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f221b7fe700 1 -- 172.21.15.31:0/2812100201 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2228012ac0 con 0x7f222c05b970 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.972+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c149670 con 0x7f222c05b970 2024-04-26T07:28:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.973+0000 7f221b7fe700 1 -- 172.21.15.31:0/2812100201 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2228022070 con 0x7f222c05b970 2024-04-26T07:28:34.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.973+0000 7f221b7fe700 1 -- 172.21.15.31:0/2812100201 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f222804ad20 con 0x7f222c05b970 2024-04-26T07:28:34.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.973+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c065ba0 con 0x7f222c05b970 2024-04-26T07:28:34.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:34.976+0000 7f221b7fe700 1 -- 172.21.15.31:0/2812100201 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2228033650 con 0x7f222c05b970 2024-04-26T07:28:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.123+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f222c06bbc0 con 0x7f222c05b970 2024-04-26T07:28:35.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.124+0000 7f221b7fe700 1 -- 172.21.15.31:0/2812100201 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2320 (secure 0 0 0) 0x7f2228033260 con 0x7f222c05b970 2024-04-26T07:28:35.125 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:35.125 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:34.834435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:28:35.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.125+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 >> v1:172.21.15.31:6816/39613 conn(0x7f220c038da0 legacy=0x7f220c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.125+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c05b970 msgr2=0x7f222c149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.125+0000 7f22345ac700 1 --2- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c05b970 0x7f222c149180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f222800c000 tx=0x7f2228006eb0).stop 2024-04-26T07:28:35.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.126+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 shutdown_connections 2024-04-26T07:28:35.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.126+0000 7f22345ac700 1 --2- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f222c1339b0 0x7f222c130930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.126+0000 7f22345ac700 1 --2- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f222c05b970 0x7f222c149180 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.126+0000 7f22345ac700 1 --2- 172.21.15.31:0/2812100201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f222c1335d0 0x7f222c130440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.126+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 >> 172.21.15.31:0/2812100201 conn(0x7f222c060ee0 msgr2=0x7f222c132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:35.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.126+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 shutdown_connections 2024-04-26T07:28:35.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.126+0000 7f22345ac700 1 -- 172.21.15.31:0/2812100201 wait complete. 2024-04-26T07:28:35.128 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 9 2024-04-26T07:28:35.137 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:35.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.242+0000 7faa928a7700 1 Processor -- start 2024-04-26T07:28:35.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.242+0000 7faa928a7700 1 -- start start 2024-04-26T07:28:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa928a7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c06c7d0 0x7faa8c1360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa928a7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c096320 0x7faa8c05b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa928a7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa8c05be60 0x7faa8c05c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa928a7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c133c10 con 0x7faa8c05be60 2024-04-26T07:28:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa928a7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c05c800 con 0x7faa8c06c7d0 2024-04-26T07:28:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa928a7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0970a0 con 0x7faa8c096320 2024-04-26T07:28:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c096320 0x7faa8c05b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa90e44700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa8c05be60 0x7faa8c05c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c06c7d0 0x7faa8c1360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c096320 0x7faa8c05b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40512/0 (socket says 172.21.15.31:40512) 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 -- 172.21.15.31:0/1319139584 learned_addr learned my addr 172.21.15.31:0/1319139584 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 -- 172.21.15.31:0/1319139584 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c06c7d0 msgr2=0x7faa8c1360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 --2- 172.21.15.31:0/1319139584 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c06c7d0 0x7faa8c1360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 -- 172.21.15.31:0/1319139584 >> v2:172.21.15.31:3300/0 conn(0x7faa8c05be60 msgr2=0x7faa8c05c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 --2- 172.21.15.31:0/1319139584 >> v2:172.21.15.31:3300/0 conn(0x7faa8c05be60 0x7faa8c05c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 -- 172.21.15.31:0/1319139584 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c136780 con 0x7faa8c096320 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa90e44700 1 --2- 172.21.15.31:0/1319139584 >> v2:172.21.15.31:3300/0 conn(0x7faa8c05be60 0x7faa8c05c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8bfff700 1 --2- 172.21.15.31:0/1319139584 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c06c7d0 0x7faa8c1360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:35.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.243+0000 7faa8b7fe700 1 --2- 172.21.15.31:0/1319139584 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c096320 0x7faa8c05b970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faa8c05c940 tx=0x7faa7c006eb0).ready entity=mon.2 client_cookie=6539d14958d08a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa8affd700 1 -- 172.21.15.31:0/1319139584 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa7c00e540 con 0x7faa8c096320 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa8affd700 1 -- 172.21.15.31:0/1319139584 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c000e90 con 0x7faa8c096320 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa8affd700 1 -- 172.21.15.31:0/1319139584 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa7c00e890 con 0x7faa8c096320 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 -- 172.21.15.31:0/1319139584 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c096320 msgr2=0x7faa8c05b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 --2- 172.21.15.31:0/1319139584 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c096320 0x7faa8c05b970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faa8c05c940 tx=0x7faa7c006eb0).stop 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 -- 172.21.15.31:0/1319139584 shutdown_connections 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 --2- 172.21.15.31:0/1319139584 >> v2:172.21.15.31:3300/0 conn(0x7faa8c05be60 0x7faa8c05c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 --2- 172.21.15.31:0/1319139584 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c06c7d0 0x7faa8c1360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 --2- 172.21.15.31:0/1319139584 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c096320 0x7faa8c05b970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 -- 172.21.15.31:0/1319139584 >> 172.21.15.31:0/1319139584 conn(0x7faa8c061370 msgr2=0x7faa8c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 -- 172.21.15.31:0/1319139584 shutdown_connections 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.244+0000 7faa928a7700 1 -- 172.21.15.31:0/1319139584 wait complete. 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.245+0000 7faa928a7700 1 Processor -- start 2024-04-26T07:28:35.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.245+0000 7faa928a7700 1 -- start start 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa928a7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c05be60 0x7faa8c0677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa928a7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c06c7d0 0x7faa8c09d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa928a7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c096320 0x7faa8c0664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa928a7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c146ae0 con 0x7faa8c096320 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa928a7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c09cfa0 con 0x7faa8c05be60 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa928a7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c09cd30 con 0x7faa8c06c7d0 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c05be60 0x7faa8c0677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c05be60 0x7faa8c0677f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39322/0 (socket says 172.21.15.31:39322) 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 -- 172.21.15.31:0/2312589836 learned_addr learned my addr 172.21.15.31:0/2312589836 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c06c7d0 0x7faa8c09d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa90e44700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c096320 0x7faa8c0664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 -- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c06c7d0 msgr2=0x7faa8c09d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c06c7d0 0x7faa8c09d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 -- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c096320 msgr2=0x7faa8c0664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c096320 0x7faa8c0664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 -- 172.21.15.31:0/2312589836 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84009470 con 0x7faa8c05be60 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8b7fe700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c06c7d0 0x7faa8c09d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa90e44700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c096320 0x7faa8c0664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.246+0000 7faa8bfff700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c05be60 0x7faa8c0677f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7faa8c09e110 tx=0x7faa74006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.247+0000 7faa897fa700 1 -- 172.21.15.31:0/2312589836 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa7400c890 con 0x7faa8c05be60 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.247+0000 7faa897fa700 1 -- 172.21.15.31:0/2312589836 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7400c9f0 con 0x7faa8c05be60 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.247+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7400b180 con 0x7faa8c05be60 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.247+0000 7faa897fa700 1 -- 172.21.15.31:0/2312589836 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa7400cd50 con 0x7faa8c05be60 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.247+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c00b1e0 con 0x7faa8c05be60 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.248+0000 7faa897fa700 1 -- 172.21.15.31:0/2312589836 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7faa7401c460 con 0x7faa8c05be60 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.248+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c136a40 con 0x7faa8c05be60 2024-04-26T07:28:35.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.248+0000 7faa897fa700 1 -- 172.21.15.31:0/2312589836 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7faa7404ae50 con 0x7faa8c05be60 2024-04-26T07:28:35.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.251+0000 7faa897fa700 1 -- 172.21.15.31:0/2312589836 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7faa74033780 con 0x7faa8c05be60 2024-04-26T07:28:35.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.368+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa8c06bbc0 con 0x7faa8c05be60 2024-04-26T07:28:35.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.369+0000 7faa897fa700 1 -- 172.21.15.31:0/2312589836 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7faa74033370 con 0x7faa8c05be60 2024-04-26T07:28:35.370 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:35.370 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:32.133218+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:35.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 >> v1:172.21.15.31:6816/39613 conn(0x7faa70038da0 legacy=0x7faa7003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c05be60 msgr2=0x7faa8c0677f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c05be60 0x7faa8c0677f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7faa8c09e110 tx=0x7faa74006df0).stop 2024-04-26T07:28:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 shutdown_connections 2024-04-26T07:28:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa8c096320 0x7faa8c0664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa8c05be60 0x7faa8c0677f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 --2- 172.21.15.31:0/2312589836 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa8c06c7d0 0x7faa8c09d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 >> 172.21.15.31:0/2312589836 conn(0x7faa8c061370 msgr2=0x7faa8c099810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 shutdown_connections 2024-04-26T07:28:35.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.370+0000 7faa928a7700 1 -- 172.21.15.31:0/2312589836 wait complete. 2024-04-26T07:28:35.382 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T07:28:35.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:28:35.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.487+0000 7f44481d9700 1 Processor -- start 2024-04-26T07:28:35.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.487+0000 7f44481d9700 1 -- start start 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f44481d9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444006c7d0 0x7f44401360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f44481d9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4440096320 0x7f444005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f44481d9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400970a0 con 0x7f444005be60 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f44481d9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4440133c10 con 0x7f4440096320 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f44481d9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4440136780 con 0x7f444006c7d0 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f4445f75700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444006c7d0 0x7f44401360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f4445f75700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444006c7d0 0x7f44401360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39334/0 (socket says 172.21.15.31:39334) 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f4445f75700 1 -- 172.21.15.31:0/254094967 learned_addr learned my addr 172.21.15.31:0/254094967 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f4445774700 1 --2- 172.21.15.31:0/254094967 >> v2:172.21.15.31:3300/0 conn(0x7f4440096320 0x7f444005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.488+0000 7f4445774700 1 -- 172.21.15.31:0/254094967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444006c7d0 msgr2=0x7f44401360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4445774700 1 --2- 172.21.15.31:0/254094967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444006c7d0 0x7f44401360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4445774700 1 -- 172.21.15.31:0/254094967 >> v1:172.21.15.31:6789/0 conn(0x7f444005be60 legacy=0x7f4440140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4445774700 1 -- 172.21.15.31:0/254094967 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440136a40 con 0x7f4440096320 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4444f73700 1 -- 172.21.15.31:0/254094967 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372648150 0 0) 0x7f44400970a0 con 0x7f444005be60 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4445f75700 1 --2- 172.21.15.31:0/254094967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444006c7d0 0x7f44401360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4445774700 1 --2- 172.21.15.31:0/254094967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4440096320 0x7f444005b970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4430002f70 tx=0x7f4430006df0).ready entity=mon.0 client_cookie=be8b5f98663947d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4444f73700 1 -- 172.21.15.31:0/254094967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443000d570 con 0x7f4440096320 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4444f73700 1 -- 172.21.15.31:0/254094967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430000e90 con 0x7f4440096320 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f4444f73700 1 -- 172.21.15.31:0/254094967 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443000d8c0 con 0x7f4440096320 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f44481d9700 1 -- 172.21.15.31:0/254094967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4440096320 msgr2=0x7f444005b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f44481d9700 1 --2- 172.21.15.31:0/254094967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4440096320 0x7f444005b970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4430002f70 tx=0x7f4430006df0).stop 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f44481d9700 1 -- 172.21.15.31:0/254094967 shutdown_connections 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f44481d9700 1 --2- 172.21.15.31:0/254094967 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f444006c7d0 0x7f44401360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f44481d9700 1 --2- 172.21.15.31:0/254094967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4440096320 0x7f444005b970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f44481d9700 1 -- 172.21.15.31:0/254094967 >> 172.21.15.31:0/254094967 conn(0x7f4440061370 msgr2=0x7f444006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:35.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f44481d9700 1 -- 172.21.15.31:0/254094967 shutdown_connections 2024-04-26T07:28:35.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.489+0000 7f44481d9700 1 -- 172.21.15.31:0/254094967 wait complete. 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.490+0000 7f44481d9700 1 Processor -- start 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.490+0000 7f44481d9700 1 -- start start 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f44481d9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f444005be60 0x7f44400635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f44481d9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f444006c7d0 0x7f4440062000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f44481d9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4440096320 0x7f44400624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f44481d9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440064dc0 con 0x7f444006c7d0 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f44481d9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4440065e60 con 0x7f4440096320 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f44481d9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4440063fc0 con 0x7f444005be60 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4445774700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f444006c7d0 0x7f4440062000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4446776700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4440096320 0x7f44400624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4445774700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f444006c7d0 0x7f4440062000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36716/0 (socket says 172.21.15.31:36716) 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4445774700 1 -- 172.21.15.31:0/1781760373 learned_addr learned my addr 172.21.15.31:0/1781760373 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4446776700 1 -- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f444005be60 msgr2=0x7f44400635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4446776700 1 --2- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f444005be60 0x7f44400635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4446776700 1 -- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f444006c7d0 msgr2=0x7f4440062000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4446776700 1 --2- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f444006c7d0 0x7f4440062000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4446776700 1 -- 172.21.15.31:0/1781760373 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c00b1e0 con 0x7f4440096320 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4445774700 1 --2- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f444006c7d0 0x7f4440062000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f4446776700 1 --2- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4440096320 0x7f44400624f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4438001250 tx=0x7f4438007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.491+0000 7f442effd700 1 -- 172.21.15.31:0/1781760373 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443800f470 con 0x7f4440096320 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.492+0000 7f442effd700 1 -- 172.21.15.31:0/1781760373 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443800f5d0 con 0x7f4440096320 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.492+0000 7f442effd700 1 -- 172.21.15.31:0/1781760373 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443800f930 con 0x7f4440096320 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.492+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443000b180 con 0x7f4440096320 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.492+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4440064310 con 0x7f4440096320 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.492+0000 7f442effd700 1 -- 172.21.15.31:0/1781760373 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4438019030 con 0x7f4440096320 2024-04-26T07:28:35.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.493+0000 7f442effd700 1 -- 172.21.15.31:0/1781760373 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f443804a020 con 0x7f4440096320 2024-04-26T07:28:35.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.493+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44400975a0 con 0x7f4440096320 2024-04-26T07:28:35.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.496+0000 7f442effd700 1 -- 172.21.15.31:0/1781760373 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f443802ef20 con 0x7f4440096320 2024-04-26T07:28:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.609+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4440139b20 con 0x7f4420038dd0 2024-04-26T07:28:35.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.616+0000 7f442effd700 1 -- 172.21.15.31:0/1781760373 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246950 (unknown 2965378022 0 3568128533) 0x7f4440139b20 con 0x7f4420038dd0 2024-04-26T07:28:35.621 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:35.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 >> v1:172.21.15.31:6816/39613 conn(0x7f4420038dd0 legacy=0x7f442003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4440096320 msgr2=0x7f44400624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 --2- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4440096320 0x7f44400624f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4438001250 tx=0x7f4438007d30).stop 2024-04-26T07:28:35.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 shutdown_connections 2024-04-26T07:28:35.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 --2- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f444005be60 0x7f44400635f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:35.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 --2- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4440096320 0x7f44400624f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 --2- 172.21.15.31:0/1781760373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f444006c7d0 0x7f4440062000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 >> 172.21.15.31:0/1781760373 conn(0x7f4440061370 msgr2=0x7f4440135e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:35.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 shutdown_connections 2024-04-26T07:28:35.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.618+0000 7f44481d9700 1 -- 172.21.15.31:0/1781760373 wait complete. 2024-04-26T07:28:35.625 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:28:35.630 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-26T07:28:33.976526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195008,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292352,"statfs":{"total":386547056640,"available":382251368448,"internally_reserved":4294967296,"allocated":688128,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.158753"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172228+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:31.172228+0000","last_peered":"2024-04-26T07:28:31.172228+0000","last_clean":"2024-04-26T07:28:31.172228+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:31.172228+0000","last_undegraded":"2024-04-26T07:28:31.172228+0000","last_fullsized":"2024-04-26T07:28:31.172228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172127+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:31.172127+0000","last_peered":"2024-04-26T07:28:31.172127+0000","last_clean":"2024-04-26T07:28:31.172127+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:31.172127+0000","last_undegraded":"2024-04-26T07:28:31.172127+0000","last_fullsized":"2024-04-26T07:28:31.172127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187271+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:31.187271+0000","last_peered":"2024-04-26T07:28:31.187271+0000","last_clean":"2024-04-26T07:28:31.187271+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:31.187271+0000","last_undegraded":"2024-04-26T07:28:31.187271+0000","last_fullsized":"2024-04-26T07:28:31.187271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187230+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:31.187230+0000","last_peered":"2024-04-26T07:28:31.187230+0000","last_clean":"2024-04-26T07:28:31.187230+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:31.187230+0000","last_undegraded":"2024-04-26T07:28:31.187230+0000","last_fullsized":"2024-04-26T07:28:31.187230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173249+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:31.173249+0000","last_peered":"2024-04-26T07:28:31.173249+0000","last_clean":"2024-04-26T07:28:31.173249+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:31.173249+0000","last_undegraded":"2024-04-26T07:28:31.173249+0000","last_fullsized":"2024-04-26T07:28:31.173249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162757+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:31.162757+0000","last_peered":"2024-04-26T07:28:31.162757+0000","last_clean":"2024-04-26T07:28:31.162757+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:31.162757+0000","last_undegraded":"2024-04-26T07:28:31.162757+0000","last_fullsized":"2024-04-26T07:28:31.162757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178804+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:31.178804+0000","last_peered":"2024-04-26T07:28:31.178804+0000","last_clean":"2024-04-26T07:28:31.178804+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:31.178804+0000","last_undegraded":"2024-04-26T07:28:31.178804+0000","last_fullsized":"2024-04-26T07:28:31.178804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186018+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:31.186018+0000","last_peered":"2024-04-26T07:28:31.186018+0000","last_clean":"2024-04-26T07:28:31.186018+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:31.186018+0000","last_undegraded":"2024-04-26T07:28:31.186018+0000","last_fullsized":"2024-04-26T07:28:31.186018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175474+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:31.175474+0000","last_peered":"2024-04-26T07:28:31.175474+0000","last_clean":"2024-04-26T07:28:31.175474+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:31.175474+0000","last_undegraded":"2024-04-26T07:28:31.175474+0000","last_fullsized":"2024-04-26T07:28:31.175474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.185784+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:31.185784+0000","last_peered":"2024-04-26T07:28:31.185784+0000","last_clean":"2024-04-26T07:28:31.185784+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:31.185784+0000","last_undegraded":"2024-04-26T07:28:31.185784+0000","last_fullsized":"2024-04-26T07:28:31.185784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.185983+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:31.185983+0000","last_peered":"2024-04-26T07:28:31.185983+0000","last_clean":"2024-04-26T07:28:31.185983+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:31.185983+0000","last_undegraded":"2024-04-26T07:28:31.185983+0000","last_fullsized":"2024-04-26T07:28:31.185983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172567+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:31.172567+0000","last_peered":"2024-04-26T07:28:31.172567+0000","last_clean":"2024-04-26T07:28:31.172567+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:31.172567+0000","last_undegraded":"2024-04-26T07:28:31.172567+0000","last_fullsized":"2024-04-26T07:28:31.172567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172409+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:31.172409+0000","last_peered":"2024-04-26T07:28:31.172409+0000","last_clean":"2024-04-26T07:28:31.172409+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:31.172409+0000","last_undegraded":"2024-04-26T07:28:31.172409+0000","last_fullsized":"2024-04-26T07:28:31.172409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174525+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:31.174525+0000","last_peered":"2024-04-26T07:28:31.174525+0000","last_clean":"2024-04-26T07:28:31.174525+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:31.174525+0000","last_undegraded":"2024-04-26T07:28:31.174525+0000","last_fullsized":"2024-04-26T07:28:31.174525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187530+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:31.187530+0000","last_peered":"2024-04-26T07:28:31.187530+0000","last_clean":"2024-04-26T07:28:31.187530+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:31.187530+0000","last_undegraded":"2024-04-26T07:28:31.187530+0000","last_fullsized":"2024-04-26T07:28:31.187530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178662+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:31.178662+0000","last_peered":"2024-04-26T07:28:31.178662+0000","last_clean":"2024-04-26T07:28:31.178662+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:31.178662+0000","last_undegraded":"2024-04-26T07:28:31.178662+0000","last_fullsized":"2024-04-26T07:28:31.178662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183192+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:31.183192+0000","last_peered":"2024-04-26T07:28:31.183192+0000","last_clean":"2024-04-26T07:28:31.183192+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:31.183192+0000","last_undegraded":"2024-04-26T07:28:31.183192+0000","last_fullsized":"2024-04-26T07:28:31.183192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180790+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:31.180790+0000","last_peered":"2024-04-26T07:28:31.180790+0000","last_clean":"2024-04-26T07:28:31.180790+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:31.180790+0000","last_undegraded":"2024-04-26T07:28:31.180790+0000","last_fullsized":"2024-04-26T07:28:31.180790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172282+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:31.172282+0000","last_peered":"2024-04-26T07:28:31.172282+0000","last_clean":"2024-04-26T07:28:31.172282+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:31.172282+0000","last_undegraded":"2024-04-26T07:28:31.172282+0000","last_fullsized":"2024-04-26T07:28:31.172282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.177992+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:31.177992+0000","last_peered":"2024-04-26T07:28:31.177992+0000","last_clean":"2024-04-26T07:28:31.177992+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:31.177992+0000","last_undegraded":"2024-04-26T07:28:31.177992+0000","last_fullsized":"2024-04-26T07:28:31.177992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.176532+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:31.176532+0000","last_peered":"2024-04-26T07:28:31.176532+0000","last_clean":"2024-04-26T07:28:31.176532+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:31.176532+0000","last_undegraded":"2024-04-26T07:28:31.176532+0000","last_fullsized":"2024-04-26T07:28:31.176532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183286+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:31.183286+0000","last_peered":"2024-04-26T07:28:31.183286+0000","last_clean":"2024-04-26T07:28:31.183286+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:31.183286+0000","last_undegraded":"2024-04-26T07:28:31.183286+0000","last_fullsized":"2024-04-26T07:28:31.183286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178817+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:31.178817+0000","last_peered":"2024-04-26T07:28:31.178817+0000","last_clean":"2024-04-26T07:28:31.178817+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:31.178817+0000","last_undegraded":"2024-04-26T07:28:31.178817+0000","last_fullsized":"2024-04-26T07:28:31.178817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.166215+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:31.166215+0000","last_peered":"2024-04-26T07:28:31.166215+0000","last_clean":"2024-04-26T07:28:31.166215+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:31.166215+0000","last_undegraded":"2024-04-26T07:28:31.166215+0000","last_fullsized":"2024-04-26T07:28:31.166215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175602+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:31.175602+0000","last_peered":"2024-04-26T07:28:31.175602+0000","last_clean":"2024-04-26T07:28:31.175602+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:31.175602+0000","last_undegraded":"2024-04-26T07:28:31.175602+0000","last_fullsized":"2024-04-26T07:28:31.175602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173623+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:31.173623+0000","last_peered":"2024-04-26T07:28:31.173623+0000","last_clean":"2024-04-26T07:28:31.173623+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:31.173623+0000","last_undegraded":"2024-04-26T07:28:31.173623+0000","last_fullsized":"2024-04-26T07:28:31.173623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179180+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:31.179180+0000","last_peered":"2024-04-26T07:28:31.179180+0000","last_clean":"2024-04-26T07:28:31.179180+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:31.179180+0000","last_undegraded":"2024-04-26T07:28:31.179180+0000","last_fullsized":"2024-04-26T07:28:31.179180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.158881+0000","last_change":"2024-04-26T07:28:30.838970+0000","last_active":"2024-04-26T07:28:31.158881+0000","last_peered":"2024-04-26T07:28:31.158881+0000","last_clean":"2024-04-26T07:28:31.158881+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:28:31.158881+0000","last_undegraded":"2024-04-26T07:28:31.158881+0000","last_fullsized":"2024-04-26T07:28:31.158881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179156+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:31.179156+0000","last_peered":"2024-04-26T07:28:31.179156+0000","last_clean":"2024-04-26T07:28:31.179156+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:31.179156+0000","last_undegraded":"2024-04-26T07:28:31.179156+0000","last_fullsized":"2024-04-26T07:28:31.179156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139848+0000","last_change":"2024-04-26T07:28:30.845233+0000","last_active":"2024-04-26T07:28:31.139848+0000","last_peered":"2024-04-26T07:28:31.139848+0000","last_clean":"2024-04-26T07:28:31.139848+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:28:31.139848+0000","last_undegraded":"2024-04-26T07:28:31.139848+0000","last_fullsized":"2024-04-26T07:28:31.139848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187631+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:31.187631+0000","last_peered":"2024-04-26T07:28:31.187631+0000","last_clean":"2024-04-26T07:28:31.187631+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:31.187631+0000","last_undegraded":"2024-04-26T07:28:31.187631+0000","last_fullsized":"2024-04-26T07:28:31.187631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136702+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:31.136702+0000","last_peered":"2024-04-26T07:28:31.136702+0000","last_clean":"2024-04-26T07:28:31.136702+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:31.136702+0000","last_undegraded":"2024-04-26T07:28:31.136702+0000","last_fullsized":"2024-04-26T07:28:31.136702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178874+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:31.178874+0000","last_peered":"2024-04-26T07:28:31.178874+0000","last_clean":"2024-04-26T07:28:31.178874+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:31.178874+0000","last_undegraded":"2024-04-26T07:28:31.178874+0000","last_fullsized":"2024-04-26T07:28:31.178874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164016+0000","last_change":"2024-04-26T07:28:30.850023+0000","last_active":"2024-04-26T07:28:31.164016+0000","last_peered":"2024-04-26T07:28:31.164016+0000","last_clean":"2024-04-26T07:28:31.164016+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:28:31.164016+0000","last_undegraded":"2024-04-26T07:28:31.164016+0000","last_fullsized":"2024-04-26T07:28:31.164016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172685+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:31.172685+0000","last_peered":"2024-04-26T07:28:31.172685+0000","last_clean":"2024-04-26T07:28:31.172685+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:31.172685+0000","last_undegraded":"2024-04-26T07:28:31.172685+0000","last_fullsized":"2024-04-26T07:28:31.172685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.151532+0000","last_change":"2024-04-26T07:28:30.853633+0000","last_active":"2024-04-26T07:28:31.151532+0000","last_peered":"2024-04-26T07:28:31.151532+0000","last_clean":"2024-04-26T07:28:31.151532+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:28:31.151532+0000","last_undegraded":"2024-04-26T07:28:31.151532+0000","last_fullsized":"2024-04-26T07:28:31.151532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178791+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:31.178791+0000","last_peered":"2024-04-26T07:28:31.178791+0000","last_clean":"2024-04-26T07:28:31.178791+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:31.178791+0000","last_undegraded":"2024-04-26T07:28:31.178791+0000","last_fullsized":"2024-04-26T07:28:31.178791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.181314+0000","last_change":"2024-04-26T07:28:30.849815+0000","last_active":"2024-04-26T07:28:31.181314+0000","last_peered":"2024-04-26T07:28:31.181314+0000","last_clean":"2024-04-26T07:28:31.181314+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:28:31.181314+0000","last_undegraded":"2024-04-26T07:28:31.181314+0000","last_fullsized":"2024-04-26T07:28:31.181314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174574+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:31.174574+0000","last_peered":"2024-04-26T07:28:31.174574+0000","last_clean":"2024-04-26T07:28:31.174574+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:31.174574+0000","last_undegraded":"2024-04-26T07:28:31.174574+0000","last_fullsized":"2024-04-26T07:28:31.174574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183287+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:28:31.183287+0000","last_peered":"2024-04-26T07:28:31.183287+0000","last_clean":"2024-04-26T07:28:31.183287+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:28:31.183287+0000","last_undegraded":"2024-04-26T07:28:31.183287+0000","last_fullsized":"2024-04-26T07:28:31.183287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172365+0000","last_change":"2024-04-26T07:28:31.165872+0000","last_active":"2024-04-26T07:28:31.172365+0000","last_peered":"2024-04-26T07:28:31.172365+0000","last_clean":"2024-04-26T07:28:31.172365+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:28:31.172365+0000","last_undegraded":"2024-04-26T07:28:31.172365+0000","last_fullsized":"2024-04-26T07:28:31.172365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.170489+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:31.170489+0000","last_peered":"2024-04-26T07:28:31.170489+0000","last_clean":"2024-04-26T07:28:31.170489+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:31.170489+0000","last_undegraded":"2024-04-26T07:28:31.170489+0000","last_fullsized":"2024-04-26T07:28:31.170489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164229+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:31.164229+0000","last_peered":"2024-04-26T07:28:31.164229+0000","last_clean":"2024-04-26T07:28:31.164229+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:31.164229+0000","last_undegraded":"2024-04-26T07:28:31.164229+0000","last_fullsized":"2024-04-26T07:28:31.164229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.144966+0000","last_change":"2024-04-26T07:28:30.847060+0000","last_active":"2024-04-26T07:28:31.144966+0000","last_peered":"2024-04-26T07:28:31.144966+0000","last_clean":"2024-04-26T07:28:31.144966+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:28:31.144966+0000","last_undegraded":"2024-04-26T07:28:31.144966+0000","last_fullsized":"2024-04-26T07:28:31.144966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179234+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:31.179234+0000","last_peered":"2024-04-26T07:28:31.179234+0000","last_clean":"2024-04-26T07:28:31.179234+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:31.179234+0000","last_undegraded":"2024-04-26T07:28:31.179234+0000","last_fullsized":"2024-04-26T07:28:31.179234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.137182+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:31.137182+0000","last_peered":"2024-04-26T07:28:31.137182+0000","last_clean":"2024-04-26T07:28:31.137182+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:31.137182+0000","last_undegraded":"2024-04-26T07:28:31.137182+0000","last_fullsized":"2024-04-26T07:28:31.137182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183231+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:31.183231+0000","last_peered":"2024-04-26T07:28:31.183231+0000","last_clean":"2024-04-26T07:28:31.183231+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:31.183231+0000","last_undegraded":"2024-04-26T07:28:31.183231+0000","last_fullsized":"2024-04-26T07:28:31.183231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180631+0000","last_change":"2024-04-26T07:28:30.839424+0000","last_active":"2024-04-26T07:28:31.180631+0000","last_peered":"2024-04-26T07:28:31.180631+0000","last_clean":"2024-04-26T07:28:31.180631+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:28:31.180631+0000","last_undegraded":"2024-04-26T07:28:31.180631+0000","last_fullsized":"2024-04-26T07:28:31.180631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178885+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:31.178885+0000","last_peered":"2024-04-26T07:28:31.178885+0000","last_clean":"2024-04-26T07:28:31.178885+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:31.178885+0000","last_undegraded":"2024-04-26T07:28:31.178885+0000","last_fullsized":"2024-04-26T07:28:31.178885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187942+0000","last_change":"2024-04-26T07:28:30.849542+0000","last_active":"2024-04-26T07:28:31.187942+0000","last_peered":"2024-04-26T07:28:31.187942+0000","last_clean":"2024-04-26T07:28:31.187942+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:28:31.187942+0000","last_undegraded":"2024-04-26T07:28:31.187942+0000","last_fullsized":"2024-04-26T07:28:31.187942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172711+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:31.172711+0000","last_peered":"2024-04-26T07:28:31.172711+0000","last_clean":"2024-04-26T07:28:31.172711+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:31.172711+0000","last_undegraded":"2024-04-26T07:28:31.172711+0000","last_fullsized":"2024-04-26T07:28:31.172711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.176121+0000","last_change":"2024-04-26T07:28:30.853399+0000","last_active":"2024-04-26T07:28:31.176121+0000","last_peered":"2024-04-26T07:28:31.176121+0000","last_clean":"2024-04-26T07:28:31.176121+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:28:31.176121+0000","last_undegraded":"2024-04-26T07:28:31.176121+0000","last_fullsized":"2024-04-26T07:28:31.176121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163472+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:31.163472+0000","last_peered":"2024-04-26T07:28:31.163472+0000","last_clean":"2024-04-26T07:28:31.163472+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:31.163472+0000","last_undegraded":"2024-04-26T07:28:31.163472+0000","last_fullsized":"2024-04-26T07:28:31.163472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172956+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:31.172956+0000","last_peered":"2024-04-26T07:28:31.172956+0000","last_clean":"2024-04-26T07:28:31.172956+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:31.172956+0000","last_undegraded":"2024-04-26T07:28:31.172956+0000","last_fullsized":"2024-04-26T07:28:31.172956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171600+0000","last_change":"2024-04-26T07:28:31.165065+0000","last_active":"2024-04-26T07:28:31.171600+0000","last_peered":"2024-04-26T07:28:31.171600+0000","last_clean":"2024-04-26T07:28:31.171600+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:28:31.171600+0000","last_undegraded":"2024-04-26T07:28:31.171600+0000","last_fullsized":"2024-04-26T07:28:31.171600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146168+0000","last_change":"2024-04-26T07:28:30.844998+0000","last_active":"2024-04-26T07:28:31.146168+0000","last_peered":"2024-04-26T07:28:31.146168+0000","last_clean":"2024-04-26T07:28:31.146168+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:28:31.146168+0000","last_undegraded":"2024-04-26T07:28:31.146168+0000","last_fullsized":"2024-04-26T07:28:31.146168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186075+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:31.186075+0000","last_peered":"2024-04-26T07:28:31.186075+0000","last_clean":"2024-04-26T07:28:31.186075+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:31.186075+0000","last_undegraded":"2024-04-26T07:28:31.186075+0000","last_fullsized":"2024-04-26T07:28:31.186075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163958+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:31.163958+0000","last_peered":"2024-04-26T07:28:31.163958+0000","last_clean":"2024-04-26T07:28:31.163958+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:31.163958+0000","last_undegraded":"2024-04-26T07:28:31.163958+0000","last_fullsized":"2024-04-26T07:28:31.163958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.169765+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:31.169765+0000","last_peered":"2024-04-26T07:28:31.169765+0000","last_clean":"2024-04-26T07:28:31.169765+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:31.169765+0000","last_undegraded":"2024-04-26T07:28:31.169765+0000","last_fullsized":"2024-04-26T07:28:31.169765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139999+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:31.139999+0000","last_peered":"2024-04-26T07:28:31.139999+0000","last_clean":"2024-04-26T07:28:31.139999+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:31.139999+0000","last_undegraded":"2024-04-26T07:28:31.139999+0000","last_fullsized":"2024-04-26T07:28:31.139999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162684+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:31.162684+0000","last_peered":"2024-04-26T07:28:31.162684+0000","last_clean":"2024-04-26T07:28:31.162684+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:31.162684+0000","last_undegraded":"2024-04-26T07:28:31.162684+0000","last_fullsized":"2024-04-26T07:28:31.162684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136564+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:31.136564+0000","last_peered":"2024-04-26T07:28:31.136564+0000","last_clean":"2024-04-26T07:28:31.136564+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:31.136564+0000","last_undegraded":"2024-04-26T07:28:31.136564+0000","last_fullsized":"2024-04-26T07:28:31.136564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172151+0000","last_change":"2024-04-26T07:28:31.164112+0000","last_active":"2024-04-26T07:28:31.172151+0000","last_peered":"2024-04-26T07:28:31.172151+0000","last_clean":"2024-04-26T07:28:31.172151+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:28:31.172151+0000","last_undegraded":"2024-04-26T07:28:31.172151+0000","last_fullsized":"2024-04-26T07:28:31.172151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136060+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:31.136060+0000","last_peered":"2024-04-26T07:28:31.136060+0000","last_clean":"2024-04-26T07:28:31.136060+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:31.136060+0000","last_undegraded":"2024-04-26T07:28:31.136060+0000","last_fullsized":"2024-04-26T07:28:31.136060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175642+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:31.175642+0000","last_peered":"2024-04-26T07:28:31.175642+0000","last_clean":"2024-04-26T07:28:31.175642+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:31.175642+0000","last_undegraded":"2024-04-26T07:28:31.175642+0000","last_fullsized":"2024-04-26T07:28:31.175642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.147037+0000","last_change":"2024-04-26T07:28:22.650334+0000","last_active":"2024-04-26T07:28:31.147037+0000","last_peered":"2024-04-26T07:28:31.147037+0000","last_clean":"2024-04-26T07:28:31.147037+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:28:31.147037+0000","last_undegraded":"2024-04-26T07:28:31.147037+0000","last_fullsized":"2024-04-26T07:28:31.147037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.147161+0000","last_change":"2024-04-26T07:28:30.851175+0000","last_active":"2024-04-26T07:28:31.147161+0000","last_peered":"2024-04-26T07:28:31.147161+0000","last_clean":"2024-04-26T07:28:31.147161+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:28:31.147161+0000","last_undegraded":"2024-04-26T07:28:31.147161+0000","last_fullsized":"2024-04-26T07:28:31.147161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174550+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:31.174550+0000","last_peered":"2024-04-26T07:28:31.174550+0000","last_clean":"2024-04-26T07:28:31.174550+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:31.174550+0000","last_undegraded":"2024-04-26T07:28:31.174550+0000","last_fullsized":"2024-04-26T07:28:31.174550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139938+0000","last_change":"2024-04-26T07:28:22.023450+0000","last_active":"2024-04-26T07:28:31.139938+0000","last_peered":"2024-04-26T07:28:31.139938+0000","last_clean":"2024-04-26T07:28:31.139938+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:28:31.139938+0000","last_undegraded":"2024-04-26T07:28:31.139938+0000","last_fullsized":"2024-04-26T07:28:31.139938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146363+0000","last_change":"2024-04-26T07:28:30.853616+0000","last_active":"2024-04-26T07:28:31.146363+0000","last_peered":"2024-04-26T07:28:31.146363+0000","last_clean":"2024-04-26T07:28:31.146363+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:28:31.146363+0000","last_undegraded":"2024-04-26T07:28:31.146363+0000","last_fullsized":"2024-04-26T07:28:31.146363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163132+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:31.163132+0000","last_peered":"2024-04-26T07:28:31.163132+0000","last_clean":"2024-04-26T07:28:31.163132+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:31.163132+0000","last_undegraded":"2024-04-26T07:28:31.163132+0000","last_fullsized":"2024-04-26T07:28:31.163132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146597+0000","last_change":"2024-04-26T07:28:22.024031+0000","last_active":"2024-04-26T07:28:31.146597+0000","last_peered":"2024-04-26T07:28:31.146597+0000","last_clean":"2024-04-26T07:28:31.146597+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:28:31.146597+0000","last_undegraded":"2024-04-26T07:28:31.146597+0000","last_fullsized":"2024-04-26T07:28:31.146597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140498+0000","last_change":"2024-04-26T07:28:30.839738+0000","last_active":"2024-04-26T07:28:31.140498+0000","last_peered":"2024-04-26T07:28:31.140498+0000","last_clean":"2024-04-26T07:28:31.140498+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:28:31.140498+0000","last_undegraded":"2024-04-26T07:28:31.140498+0000","last_fullsized":"2024-04-26T07:28:31.140498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186048+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:31.186048+0000","last_peered":"2024-04-26T07:28:31.186048+0000","last_clean":"2024-04-26T07:28:31.186048+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:31.186048+0000","last_undegraded":"2024-04-26T07:28:31.186048+0000","last_fullsized":"2024-04-26T07:28:31.186048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139873+0000","last_change":"2024-04-26T07:28:22.023795+0000","last_active":"2024-04-26T07:28:31.139873+0000","last_peered":"2024-04-26T07:28:31.139873+0000","last_clean":"2024-04-26T07:28:31.139873+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:28:31.139873+0000","last_undegraded":"2024-04-26T07:28:31.139873+0000","last_fullsized":"2024-04-26T07:28:31.139873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140354+0000","last_change":"2024-04-26T07:28:18.549478+0000","last_active":"2024-04-26T07:28:31.140354+0000","last_peered":"2024-04-26T07:28:31.140354+0000","last_clean":"2024-04-26T07:28:31.140354+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:28:31.140354+0000","last_undegraded":"2024-04-26T07:28:31.140354+0000","last_fullsized":"2024-04-26T07:28:31.140354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_clean_scrub_stamp":"2024-04-26T07:28:14.971410+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.135798+0000","last_change":"2024-04-26T07:28:30.859261+0000","last_active":"2024-04-26T07:28:31.135798+0000","last_peered":"2024-04-26T07:28:31.135798+0000","last_clean":"2024-04-26T07:28:31.135798+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:28:31.135798+0000","last_undegraded":"2024-04-26T07:28:31.135798+0000","last_fullsized":"2024-04-26T07:28:31.135798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179112+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:31.179112+0000","last_peered":"2024-04-26T07:28:31.179112+0000","last_clean":"2024-04-26T07:28:31.179112+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:31.179112+0000","last_undegraded":"2024-04-26T07:28:31.179112+0000","last_fullsized":"2024-04-26T07:28:31.179112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136584+0000","last_change":"2024-04-26T07:28:22.026306+0000","last_active":"2024-04-26T07:28:31.136584+0000","last_peered":"2024-04-26T07:28:31.136584+0000","last_clean":"2024-04-26T07:28:31.136584+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:28:31.136584+0000","last_undegraded":"2024-04-26T07:28:31.136584+0000","last_fullsized":"2024-04-26T07:28:31.136584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.165117+0000","last_change":"2024-04-26T07:28:30.854930+0000","last_active":"2024-04-26T07:28:31.165117+0000","last_peered":"2024-04-26T07:28:31.165117+0000","last_clean":"2024-04-26T07:28:31.165117+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:28:31.165117+0000","last_undegraded":"2024-04-26T07:28:31.165117+0000","last_fullsized":"2024-04-26T07:28:31.165117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186614+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:31.186614+0000","last_peered":"2024-04-26T07:28:31.186614+0000","last_clean":"2024-04-26T07:28:31.186614+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:31.186614+0000","last_undegraded":"2024-04-26T07:28:31.186614+0000","last_fullsized":"2024-04-26T07:28:31.186614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.149451+0000","last_change":"2024-04-26T07:28:22.650352+0000","last_active":"2024-04-26T07:28:31.149451+0000","last_peered":"2024-04-26T07:28:31.149451+0000","last_clean":"2024-04-26T07:28:31.149451+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:28:31.149451+0000","last_undegraded":"2024-04-26T07:28:31.149451+0000","last_fullsized":"2024-04-26T07:28:31.149451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140458+0000","last_change":"2024-04-26T07:28:30.844050+0000","last_active":"2024-04-26T07:28:31.140458+0000","last_peered":"2024-04-26T07:28:31.140458+0000","last_clean":"2024-04-26T07:28:31.140458+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:28:31.140458+0000","last_undegraded":"2024-04-26T07:28:31.140458+0000","last_fullsized":"2024-04-26T07:28:31.140458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180827+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:31.180827+0000","last_peered":"2024-04-26T07:28:31.180827+0000","last_clean":"2024-04-26T07:28:31.180827+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:31.180827+0000","last_undegraded":"2024-04-26T07:28:31.180827+0000","last_fullsized":"2024-04-26T07:28:31.180827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173344+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:31.173344+0000","last_peered":"2024-04-26T07:28:31.173344+0000","last_clean":"2024-04-26T07:28:31.173344+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:31.173344+0000","last_undegraded":"2024-04-26T07:28:31.173344+0000","last_fullsized":"2024-04-26T07:28:31.173344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140850+0000","last_change":"2024-04-26T07:28:22.650310+0000","last_active":"2024-04-26T07:28:31.140850+0000","last_peered":"2024-04-26T07:28:31.140850+0000","last_clean":"2024-04-26T07:28:31.140850+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:28:31.140850+0000","last_undegraded":"2024-04-26T07:28:31.140850+0000","last_fullsized":"2024-04-26T07:28:31.140850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172737+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:31.172737+0000","last_peered":"2024-04-26T07:28:31.172737+0000","last_clean":"2024-04-26T07:28:31.172737+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:31.172737+0000","last_undegraded":"2024-04-26T07:28:31.172737+0000","last_fullsized":"2024-04-26T07:28:31.172737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.142937+0000","last_change":"2024-04-26T07:28:22.650378+0000","last_active":"2024-04-26T07:28:31.142937+0000","last_peered":"2024-04-26T07:28:31.142937+0000","last_clean":"2024-04-26T07:28:31.142937+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:28:31.142937+0000","last_undegraded":"2024-04-26T07:28:31.142937+0000","last_fullsized":"2024-04-26T07:28:31.142937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142805+0000","last_change":"2024-04-26T07:28:30.848849+0000","last_active":"2024-04-26T07:28:32.142805+0000","last_peered":"2024-04-26T07:28:32.142805+0000","last_clean":"2024-04-26T07:28:32.142805+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:28:32.142805+0000","last_undegraded":"2024-04-26T07:28:32.142805+0000","last_fullsized":"2024-04-26T07:28:32.142805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172185+0000","last_change":"2024-04-26T07:28:31.160967+0000","last_active":"2024-04-26T07:28:31.172185+0000","last_peered":"2024-04-26T07:28:31.172185+0000","last_clean":"2024-04-26T07:28:31.172185+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:28:31.172185+0000","last_undegraded":"2024-04-26T07:28:31.172185+0000","last_fullsized":"2024-04-26T07:28:31.172185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178720+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:31.178720+0000","last_peered":"2024-04-26T07:28:31.178720+0000","last_clean":"2024-04-26T07:28:31.178720+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:31.178720+0000","last_undegraded":"2024-04-26T07:28:31.178720+0000","last_fullsized":"2024-04-26T07:28:31.178720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.161796+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:31.161796+0000","last_peered":"2024-04-26T07:28:31.161796+0000","last_clean":"2024-04-26T07:28:31.161796+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:31.161796+0000","last_undegraded":"2024-04-26T07:28:31.161796+0000","last_fullsized":"2024-04-26T07:28:31.161796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178894+0000","last_change":"2024-04-26T07:28:30.852699+0000","last_active":"2024-04-26T07:28:31.178894+0000","last_peered":"2024-04-26T07:28:31.178894+0000","last_clean":"2024-04-26T07:28:31.178894+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:28:31.178894+0000","last_undegraded":"2024-04-26T07:28:31.178894+0000","last_fullsized":"2024-04-26T07:28:31.178894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172388+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:31.172388+0000","last_peered":"2024-04-26T07:28:31.172388+0000","last_clean":"2024-04-26T07:28:31.172388+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:31.172388+0000","last_undegraded":"2024-04-26T07:28:31.172388+0000","last_fullsized":"2024-04-26T07:28:31.172388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.177540+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:31.177540+0000","last_peered":"2024-04-26T07:28:31.177540+0000","last_clean":"2024-04-26T07:28:31.177540+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:31.177540+0000","last_undegraded":"2024-04-26T07:28:31.177540+0000","last_fullsized":"2024-04-26T07:28:31.177540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171622+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:31.171622+0000","last_peered":"2024-04-26T07:28:31.171622+0000","last_clean":"2024-04-26T07:28:31.171622+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:31.171622+0000","last_undegraded":"2024-04-26T07:28:31.171622+0000","last_fullsized":"2024-04-26T07:28:31.171622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.156602+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:31.156602+0000","last_peered":"2024-04-26T07:28:31.156602+0000","last_clean":"2024-04-26T07:28:31.156602+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:31.156602+0000","last_undegraded":"2024-04-26T07:28:31.156602+0000","last_fullsized":"2024-04-26T07:28:31.156602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162955+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:31.162955+0000","last_peered":"2024-04-26T07:28:31.162955+0000","last_clean":"2024-04-26T07:28:31.162955+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:31.162955+0000","last_undegraded":"2024-04-26T07:28:31.162955+0000","last_fullsized":"2024-04-26T07:28:31.162955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187941+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:31.187941+0000","last_peered":"2024-04-26T07:28:31.187941+0000","last_clean":"2024-04-26T07:28:31.187941+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:31.187941+0000","last_undegraded":"2024-04-26T07:28:31.187941+0000","last_fullsized":"2024-04-26T07:28:31.187941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171434+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:31.171434+0000","last_peered":"2024-04-26T07:28:31.171434+0000","last_clean":"2024-04-26T07:28:31.171434+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:31.171434+0000","last_undegraded":"2024-04-26T07:28:31.171434+0000","last_fullsized":"2024-04-26T07:28:31.171434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.166241+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:31.166241+0000","last_peered":"2024-04-26T07:28:31.166241+0000","last_clean":"2024-04-26T07:28:31.166241+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:31.166241+0000","last_undegraded":"2024-04-26T07:28:31.166241+0000","last_fullsized":"2024-04-26T07:28:31.166241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162933+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:31.162933+0000","last_peered":"2024-04-26T07:28:31.162933+0000","last_clean":"2024-04-26T07:28:31.162933+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:31.162933+0000","last_undegraded":"2024-04-26T07:28:31.162933+0000","last_fullsized":"2024-04-26T07:28:31.162933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.169782+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:31.169782+0000","last_peered":"2024-04-26T07:28:31.169782+0000","last_clean":"2024-04-26T07:28:31.169782+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:31.169782+0000","last_undegraded":"2024-04-26T07:28:31.169782+0000","last_fullsized":"2024-04-26T07:28:31.169782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164315+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:31.164315+0000","last_peered":"2024-04-26T07:28:31.164315+0000","last_clean":"2024-04-26T07:28:31.164315+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:31.164315+0000","last_undegraded":"2024-04-26T07:28:31.164315+0000","last_fullsized":"2024-04-26T07:28:31.164315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173981+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:31.173981+0000","last_peered":"2024-04-26T07:28:31.173981+0000","last_clean":"2024-04-26T07:28:31.173981+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:31.173981+0000","last_undegraded":"2024-04-26T07:28:31.173981+0000","last_fullsized":"2024-04-26T07:28:31.173981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":52577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":52383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":51547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]}]}} 2024-04-26T07:28:35.635 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:28:35.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.776+0000 7f4cd000d700 1 Processor -- start 2024-04-26T07:28:35.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.776+0000 7f4cd000d700 1 -- start start 2024-04-26T07:28:35.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4cd000d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc81360f0 0x7f4cc8096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4cd000d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc805c080 0x7f4cc8141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4cd000d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc80970a0 con 0x7f4cc806c7d0 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4cd000d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8133c10 con 0x7f4cc81360f0 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4cd000d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8096810 con 0x7f4cc805c080 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4ccd5a8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc81360f0 0x7f4cc8096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4ccdda9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4cc806c7d0 0x7f4cc805b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46598/0 (socket says 172.21.15.31:46598) 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4cce5aa700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc805c080 0x7f4cc8141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4ccdda9700 1 -- 172.21.15.31:0/992758417 learned_addr learned my addr 172.21.15.31:0/992758417 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4cccda7700 1 -- 172.21.15.31:0/992758417 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179881295 0 0) 0x7f4cc80970a0 con 0x7f4cc806c7d0 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4ccd5a8700 1 -- 172.21.15.31:0/992758417 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc805c080 msgr2=0x7f4cc8141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4ccd5a8700 1 --2- 172.21.15.31:0/992758417 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc805c080 0x7f4cc8141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4ccd5a8700 1 -- 172.21.15.31:0/992758417 >> v1:172.21.15.31:6789/0 conn(0x7f4cc806c7d0 legacy=0x7f4cc805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4ccd5a8700 1 -- 172.21.15.31:0/992758417 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc81364d0 con 0x7f4cc81360f0 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4cce5aa700 1 --2- 172.21.15.31:0/992758417 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc805c080 0x7f4cc8141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.777+0000 7f4ccd5a8700 1 --2- 172.21.15.31:0/992758417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc81360f0 0x7f4cc8096320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4cc4002f70 tx=0x7f4cc4006df0).ready entity=mon.1 client_cookie=83af4e1545a3a3b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:35.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cccda7700 1 -- 172.21.15.31:0/992758417 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cc400d570 con 0x7f4cc81360f0 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cccda7700 1 -- 172.21.15.31:0/992758417 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc4000e90 con 0x7f4cc81360f0 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cccda7700 1 -- 172.21.15.31:0/992758417 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cc400d8c0 con 0x7f4cc81360f0 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cd000d700 1 -- 172.21.15.31:0/992758417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc81360f0 msgr2=0x7f4cc8096320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cd000d700 1 --2- 172.21.15.31:0/992758417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc81360f0 0x7f4cc8096320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4cc4002f70 tx=0x7f4cc4006df0).stop 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cd000d700 1 -- 172.21.15.31:0/992758417 shutdown_connections 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cd000d700 1 --2- 172.21.15.31:0/992758417 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc805c080 0x7f4cc8141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cd000d700 1 --2- 172.21.15.31:0/992758417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc81360f0 0x7f4cc8096320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cd000d700 1 -- 172.21.15.31:0/992758417 >> 172.21.15.31:0/992758417 conn(0x7f4cc8061370 msgr2=0x7f4cc806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cd000d700 1 -- 172.21.15.31:0/992758417 shutdown_connections 2024-04-26T07:28:35.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.778+0000 7f4cd000d700 1 -- 172.21.15.31:0/992758417 wait complete. 2024-04-26T07:28:35.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.779+0000 7f4cd000d700 1 Processor -- start 2024-04-26T07:28:35.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.779+0000 7f4cd000d700 1 -- start start 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4cd000d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc805c080 0x7f4cc8065d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4cd000d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc806c7d0 0x7f4cc8149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4cd000d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc81360f0 0x7f4cc81499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4cd000d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8063a80 con 0x7f4cc806c7d0 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4cd000d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc81492d0 con 0x7f4cc805c080 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4cd000d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8065560 con 0x7f4cc81360f0 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccdda9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc805c080 0x7f4cc8065d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4cce5aa700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc81360f0 0x7f4cc81499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccdda9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc805c080 0x7f4cc8065d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39360/0 (socket says 172.21.15.31:39360) 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccdda9700 1 -- 172.21.15.31:0/1284281243 learned_addr learned my addr 172.21.15.31:0/1284281243 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:35.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccd5a8700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc806c7d0 0x7f4cc8149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccdda9700 1 -- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc81360f0 msgr2=0x7f4cc81499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccdda9700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc81360f0 0x7f4cc81499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccdda9700 1 -- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc806c7d0 msgr2=0x7f4cc8149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccdda9700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc806c7d0 0x7f4cc8149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.780+0000 7f4ccdda9700 1 -- 172.21.15.31:0/1284281243 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc0009470 con 0x7f4cc805c080 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.781+0000 7f4cce5aa700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc81360f0 0x7f4cc81499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.781+0000 7f4ccdda9700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc805c080 0x7f4cc8065d40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4cb8000bc0 tx=0x7f4cb8007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.781+0000 7f4cb6ffd700 1 -- 172.21.15.31:0/1284281243 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cb80070d0 con 0x7f4cc805c080 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.781+0000 7f4cb6ffd700 1 -- 172.21.15.31:0/1284281243 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb8007230 con 0x7f4cc805c080 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.781+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc400b180 con 0x7f4cc805c080 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.781+0000 7f4cb6ffd700 1 -- 172.21.15.31:0/1284281243 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cb8005610 con 0x7f4cc805c080 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.781+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc8064ac0 con 0x7f4cc805c080 2024-04-26T07:28:35.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.782+0000 7f4cb6ffd700 1 -- 172.21.15.31:0/1284281243 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4cb8010070 con 0x7f4cc805c080 2024-04-26T07:28:35.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.782+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc8136780 con 0x7f4cc805c080 2024-04-26T07:28:35.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.782+0000 7f4cb6ffd700 1 -- 172.21.15.31:0/1284281243 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4cb8049fe0 con 0x7f4cc805c080 2024-04-26T07:28:35.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.785+0000 7f4cb6ffd700 1 -- 172.21.15.31:0/1284281243 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4cb802ed10 con 0x7f4cc805c080 2024-04-26T07:28:35.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.899+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cc806bbc0 con 0x7f4ca8038ec0 2024-04-26T07:28:35.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.906+0000 7f4cb6ffd700 1 -- 172.21.15.31:0/1284281243 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246950 (unknown 2965378022 0 3568128533) 0x7f4cc806bbc0 con 0x7f4ca8038ec0 2024-04-26T07:28:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:35.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 >> v1:172.21.15.31:6816/39613 conn(0x7f4ca8038ec0 legacy=0x7f4ca803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc805c080 msgr2=0x7f4cc8065d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:35.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc805c080 0x7f4cc8065d40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4cb8000bc0 tx=0x7f4cb8007a60).stop 2024-04-26T07:28:35.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 shutdown_connections 2024-04-26T07:28:35.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4cc81360f0 0x7f4cc81499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4cc805c080 0x7f4cc8065d40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 --2- 172.21.15.31:0/1284281243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc806c7d0 0x7f4cc8149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 >> 172.21.15.31:0/1284281243 conn(0x7f4cc8061370 msgr2=0x7f4cc80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 shutdown_connections 2024-04-26T07:28:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:35.909+0000 7f4cd000d700 1 -- 172.21.15.31:0/1284281243 wait complete. 2024-04-26T07:28:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:28:35.920 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-26T07:28:33.976526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195008,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292352,"statfs":{"total":386547056640,"available":382251368448,"internally_reserved":4294967296,"allocated":688128,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.158753"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172228+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:31.172228+0000","last_peered":"2024-04-26T07:28:31.172228+0000","last_clean":"2024-04-26T07:28:31.172228+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:31.172228+0000","last_undegraded":"2024-04-26T07:28:31.172228+0000","last_fullsized":"2024-04-26T07:28:31.172228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172127+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:31.172127+0000","last_peered":"2024-04-26T07:28:31.172127+0000","last_clean":"2024-04-26T07:28:31.172127+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:31.172127+0000","last_undegraded":"2024-04-26T07:28:31.172127+0000","last_fullsized":"2024-04-26T07:28:31.172127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187271+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:31.187271+0000","last_peered":"2024-04-26T07:28:31.187271+0000","last_clean":"2024-04-26T07:28:31.187271+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:31.187271+0000","last_undegraded":"2024-04-26T07:28:31.187271+0000","last_fullsized":"2024-04-26T07:28:31.187271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187230+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:31.187230+0000","last_peered":"2024-04-26T07:28:31.187230+0000","last_clean":"2024-04-26T07:28:31.187230+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:31.187230+0000","last_undegraded":"2024-04-26T07:28:31.187230+0000","last_fullsized":"2024-04-26T07:28:31.187230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173249+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:31.173249+0000","last_peered":"2024-04-26T07:28:31.173249+0000","last_clean":"2024-04-26T07:28:31.173249+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:31.173249+0000","last_undegraded":"2024-04-26T07:28:31.173249+0000","last_fullsized":"2024-04-26T07:28:31.173249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162757+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:31.162757+0000","last_peered":"2024-04-26T07:28:31.162757+0000","last_clean":"2024-04-26T07:28:31.162757+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:31.162757+0000","last_undegraded":"2024-04-26T07:28:31.162757+0000","last_fullsized":"2024-04-26T07:28:31.162757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178804+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:31.178804+0000","last_peered":"2024-04-26T07:28:31.178804+0000","last_clean":"2024-04-26T07:28:31.178804+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:31.178804+0000","last_undegraded":"2024-04-26T07:28:31.178804+0000","last_fullsized":"2024-04-26T07:28:31.178804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186018+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:31.186018+0000","last_peered":"2024-04-26T07:28:31.186018+0000","last_clean":"2024-04-26T07:28:31.186018+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:31.186018+0000","last_undegraded":"2024-04-26T07:28:31.186018+0000","last_fullsized":"2024-04-26T07:28:31.186018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175474+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:31.175474+0000","last_peered":"2024-04-26T07:28:31.175474+0000","last_clean":"2024-04-26T07:28:31.175474+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:31.175474+0000","last_undegraded":"2024-04-26T07:28:31.175474+0000","last_fullsized":"2024-04-26T07:28:31.175474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.185784+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:31.185784+0000","last_peered":"2024-04-26T07:28:31.185784+0000","last_clean":"2024-04-26T07:28:31.185784+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:31.185784+0000","last_undegraded":"2024-04-26T07:28:31.185784+0000","last_fullsized":"2024-04-26T07:28:31.185784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.185983+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:31.185983+0000","last_peered":"2024-04-26T07:28:31.185983+0000","last_clean":"2024-04-26T07:28:31.185983+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:31.185983+0000","last_undegraded":"2024-04-26T07:28:31.185983+0000","last_fullsized":"2024-04-26T07:28:31.185983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172567+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:31.172567+0000","last_peered":"2024-04-26T07:28:31.172567+0000","last_clean":"2024-04-26T07:28:31.172567+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:31.172567+0000","last_undegraded":"2024-04-26T07:28:31.172567+0000","last_fullsized":"2024-04-26T07:28:31.172567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172409+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:31.172409+0000","last_peered":"2024-04-26T07:28:31.172409+0000","last_clean":"2024-04-26T07:28:31.172409+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:31.172409+0000","last_undegraded":"2024-04-26T07:28:31.172409+0000","last_fullsized":"2024-04-26T07:28:31.172409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174525+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:31.174525+0000","last_peered":"2024-04-26T07:28:31.174525+0000","last_clean":"2024-04-26T07:28:31.174525+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:31.174525+0000","last_undegraded":"2024-04-26T07:28:31.174525+0000","last_fullsized":"2024-04-26T07:28:31.174525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187530+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:31.187530+0000","last_peered":"2024-04-26T07:28:31.187530+0000","last_clean":"2024-04-26T07:28:31.187530+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:31.187530+0000","last_undegraded":"2024-04-26T07:28:31.187530+0000","last_fullsized":"2024-04-26T07:28:31.187530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178662+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:31.178662+0000","last_peered":"2024-04-26T07:28:31.178662+0000","last_clean":"2024-04-26T07:28:31.178662+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:31.178662+0000","last_undegraded":"2024-04-26T07:28:31.178662+0000","last_fullsized":"2024-04-26T07:28:31.178662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183192+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:31.183192+0000","last_peered":"2024-04-26T07:28:31.183192+0000","last_clean":"2024-04-26T07:28:31.183192+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:31.183192+0000","last_undegraded":"2024-04-26T07:28:31.183192+0000","last_fullsized":"2024-04-26T07:28:31.183192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180790+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:31.180790+0000","last_peered":"2024-04-26T07:28:31.180790+0000","last_clean":"2024-04-26T07:28:31.180790+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:31.180790+0000","last_undegraded":"2024-04-26T07:28:31.180790+0000","last_fullsized":"2024-04-26T07:28:31.180790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172282+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:31.172282+0000","last_peered":"2024-04-26T07:28:31.172282+0000","last_clean":"2024-04-26T07:28:31.172282+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:31.172282+0000","last_undegraded":"2024-04-26T07:28:31.172282+0000","last_fullsized":"2024-04-26T07:28:31.172282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.177992+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:31.177992+0000","last_peered":"2024-04-26T07:28:31.177992+0000","last_clean":"2024-04-26T07:28:31.177992+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:31.177992+0000","last_undegraded":"2024-04-26T07:28:31.177992+0000","last_fullsized":"2024-04-26T07:28:31.177992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.176532+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:31.176532+0000","last_peered":"2024-04-26T07:28:31.176532+0000","last_clean":"2024-04-26T07:28:31.176532+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:31.176532+0000","last_undegraded":"2024-04-26T07:28:31.176532+0000","last_fullsized":"2024-04-26T07:28:31.176532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183286+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:31.183286+0000","last_peered":"2024-04-26T07:28:31.183286+0000","last_clean":"2024-04-26T07:28:31.183286+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:31.183286+0000","last_undegraded":"2024-04-26T07:28:31.183286+0000","last_fullsized":"2024-04-26T07:28:31.183286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178817+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:31.178817+0000","last_peered":"2024-04-26T07:28:31.178817+0000","last_clean":"2024-04-26T07:28:31.178817+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:31.178817+0000","last_undegraded":"2024-04-26T07:28:31.178817+0000","last_fullsized":"2024-04-26T07:28:31.178817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.166215+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:31.166215+0000","last_peered":"2024-04-26T07:28:31.166215+0000","last_clean":"2024-04-26T07:28:31.166215+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:31.166215+0000","last_undegraded":"2024-04-26T07:28:31.166215+0000","last_fullsized":"2024-04-26T07:28:31.166215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175602+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:31.175602+0000","last_peered":"2024-04-26T07:28:31.175602+0000","last_clean":"2024-04-26T07:28:31.175602+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:31.175602+0000","last_undegraded":"2024-04-26T07:28:31.175602+0000","last_fullsized":"2024-04-26T07:28:31.175602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173623+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:31.173623+0000","last_peered":"2024-04-26T07:28:31.173623+0000","last_clean":"2024-04-26T07:28:31.173623+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:31.173623+0000","last_undegraded":"2024-04-26T07:28:31.173623+0000","last_fullsized":"2024-04-26T07:28:31.173623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179180+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:31.179180+0000","last_peered":"2024-04-26T07:28:31.179180+0000","last_clean":"2024-04-26T07:28:31.179180+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:31.179180+0000","last_undegraded":"2024-04-26T07:28:31.179180+0000","last_fullsized":"2024-04-26T07:28:31.179180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.158881+0000","last_change":"2024-04-26T07:28:30.838970+0000","last_active":"2024-04-26T07:28:31.158881+0000","last_peered":"2024-04-26T07:28:31.158881+0000","last_clean":"2024-04-26T07:28:31.158881+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:28:31.158881+0000","last_undegraded":"2024-04-26T07:28:31.158881+0000","last_fullsized":"2024-04-26T07:28:31.158881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179156+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:31.179156+0000","last_peered":"2024-04-26T07:28:31.179156+0000","last_clean":"2024-04-26T07:28:31.179156+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:31.179156+0000","last_undegraded":"2024-04-26T07:28:31.179156+0000","last_fullsized":"2024-04-26T07:28:31.179156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139848+0000","last_change":"2024-04-26T07:28:30.845233+0000","last_active":"2024-04-26T07:28:31.139848+0000","last_peered":"2024-04-26T07:28:31.139848+0000","last_clean":"2024-04-26T07:28:31.139848+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:28:31.139848+0000","last_undegraded":"2024-04-26T07:28:31.139848+0000","last_fullsized":"2024-04-26T07:28:31.139848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187631+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:31.187631+0000","last_peered":"2024-04-26T07:28:31.187631+0000","last_clean":"2024-04-26T07:28:31.187631+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:31.187631+0000","last_undegraded":"2024-04-26T07:28:31.187631+0000","last_fullsized":"2024-04-26T07:28:31.187631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136702+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:31.136702+0000","last_peered":"2024-04-26T07:28:31.136702+0000","last_clean":"2024-04-26T07:28:31.136702+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:31.136702+0000","last_undegraded":"2024-04-26T07:28:31.136702+0000","last_fullsized":"2024-04-26T07:28:31.136702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178874+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:31.178874+0000","last_peered":"2024-04-26T07:28:31.178874+0000","last_clean":"2024-04-26T07:28:31.178874+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:31.178874+0000","last_undegraded":"2024-04-26T07:28:31.178874+0000","last_fullsized":"2024-04-26T07:28:31.178874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164016+0000","last_change":"2024-04-26T07:28:30.850023+0000","last_active":"2024-04-26T07:28:31.164016+0000","last_peered":"2024-04-26T07:28:31.164016+0000","last_clean":"2024-04-26T07:28:31.164016+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:28:31.164016+0000","last_undegraded":"2024-04-26T07:28:31.164016+0000","last_fullsized":"2024-04-26T07:28:31.164016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172685+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:31.172685+0000","last_peered":"2024-04-26T07:28:31.172685+0000","last_clean":"2024-04-26T07:28:31.172685+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:31.172685+0000","last_undegraded":"2024-04-26T07:28:31.172685+0000","last_fullsized":"2024-04-26T07:28:31.172685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.151532+0000","last_change":"2024-04-26T07:28:30.853633+0000","last_active":"2024-04-26T07:28:31.151532+0000","last_peered":"2024-04-26T07:28:31.151532+0000","last_clean":"2024-04-26T07:28:31.151532+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:28:31.151532+0000","last_undegraded":"2024-04-26T07:28:31.151532+0000","last_fullsized":"2024-04-26T07:28:31.151532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178791+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:31.178791+0000","last_peered":"2024-04-26T07:28:31.178791+0000","last_clean":"2024-04-26T07:28:31.178791+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:31.178791+0000","last_undegraded":"2024-04-26T07:28:31.178791+0000","last_fullsized":"2024-04-26T07:28:31.178791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.181314+0000","last_change":"2024-04-26T07:28:30.849815+0000","last_active":"2024-04-26T07:28:31.181314+0000","last_peered":"2024-04-26T07:28:31.181314+0000","last_clean":"2024-04-26T07:28:31.181314+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:28:31.181314+0000","last_undegraded":"2024-04-26T07:28:31.181314+0000","last_fullsized":"2024-04-26T07:28:31.181314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174574+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:31.174574+0000","last_peered":"2024-04-26T07:28:31.174574+0000","last_clean":"2024-04-26T07:28:31.174574+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:31.174574+0000","last_undegraded":"2024-04-26T07:28:31.174574+0000","last_fullsized":"2024-04-26T07:28:31.174574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183287+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:28:31.183287+0000","last_peered":"2024-04-26T07:28:31.183287+0000","last_clean":"2024-04-26T07:28:31.183287+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:28:31.183287+0000","last_undegraded":"2024-04-26T07:28:31.183287+0000","last_fullsized":"2024-04-26T07:28:31.183287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172365+0000","last_change":"2024-04-26T07:28:31.165872+0000","last_active":"2024-04-26T07:28:31.172365+0000","last_peered":"2024-04-26T07:28:31.172365+0000","last_clean":"2024-04-26T07:28:31.172365+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:28:31.172365+0000","last_undegraded":"2024-04-26T07:28:31.172365+0000","last_fullsized":"2024-04-26T07:28:31.172365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.170489+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:31.170489+0000","last_peered":"2024-04-26T07:28:31.170489+0000","last_clean":"2024-04-26T07:28:31.170489+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:31.170489+0000","last_undegraded":"2024-04-26T07:28:31.170489+0000","last_fullsized":"2024-04-26T07:28:31.170489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164229+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:31.164229+0000","last_peered":"2024-04-26T07:28:31.164229+0000","last_clean":"2024-04-26T07:28:31.164229+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:31.164229+0000","last_undegraded":"2024-04-26T07:28:31.164229+0000","last_fullsized":"2024-04-26T07:28:31.164229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.144966+0000","last_change":"2024-04-26T07:28:30.847060+0000","last_active":"2024-04-26T07:28:31.144966+0000","last_peered":"2024-04-26T07:28:31.144966+0000","last_clean":"2024-04-26T07:28:31.144966+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:28:31.144966+0000","last_undegraded":"2024-04-26T07:28:31.144966+0000","last_fullsized":"2024-04-26T07:28:31.144966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179234+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:31.179234+0000","last_peered":"2024-04-26T07:28:31.179234+0000","last_clean":"2024-04-26T07:28:31.179234+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:31.179234+0000","last_undegraded":"2024-04-26T07:28:31.179234+0000","last_fullsized":"2024-04-26T07:28:31.179234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.137182+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:31.137182+0000","last_peered":"2024-04-26T07:28:31.137182+0000","last_clean":"2024-04-26T07:28:31.137182+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:31.137182+0000","last_undegraded":"2024-04-26T07:28:31.137182+0000","last_fullsized":"2024-04-26T07:28:31.137182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183231+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:31.183231+0000","last_peered":"2024-04-26T07:28:31.183231+0000","last_clean":"2024-04-26T07:28:31.183231+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:31.183231+0000","last_undegraded":"2024-04-26T07:28:31.183231+0000","last_fullsized":"2024-04-26T07:28:31.183231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180631+0000","last_change":"2024-04-26T07:28:30.839424+0000","last_active":"2024-04-26T07:28:31.180631+0000","last_peered":"2024-04-26T07:28:31.180631+0000","last_clean":"2024-04-26T07:28:31.180631+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:28:31.180631+0000","last_undegraded":"2024-04-26T07:28:31.180631+0000","last_fullsized":"2024-04-26T07:28:31.180631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178885+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:31.178885+0000","last_peered":"2024-04-26T07:28:31.178885+0000","last_clean":"2024-04-26T07:28:31.178885+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:31.178885+0000","last_undegraded":"2024-04-26T07:28:31.178885+0000","last_fullsized":"2024-04-26T07:28:31.178885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187942+0000","last_change":"2024-04-26T07:28:30.849542+0000","last_active":"2024-04-26T07:28:31.187942+0000","last_peered":"2024-04-26T07:28:31.187942+0000","last_clean":"2024-04-26T07:28:31.187942+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:28:31.187942+0000","last_undegraded":"2024-04-26T07:28:31.187942+0000","last_fullsized":"2024-04-26T07:28:31.187942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172711+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:31.172711+0000","last_peered":"2024-04-26T07:28:31.172711+0000","last_clean":"2024-04-26T07:28:31.172711+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:31.172711+0000","last_undegraded":"2024-04-26T07:28:31.172711+0000","last_fullsized":"2024-04-26T07:28:31.172711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.176121+0000","last_change":"2024-04-26T07:28:30.853399+0000","last_active":"2024-04-26T07:28:31.176121+0000","last_peered":"2024-04-26T07:28:31.176121+0000","last_clean":"2024-04-26T07:28:31.176121+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:28:31.176121+0000","last_undegraded":"2024-04-26T07:28:31.176121+0000","last_fullsized":"2024-04-26T07:28:31.176121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163472+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:31.163472+0000","last_peered":"2024-04-26T07:28:31.163472+0000","last_clean":"2024-04-26T07:28:31.163472+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:31.163472+0000","last_undegraded":"2024-04-26T07:28:31.163472+0000","last_fullsized":"2024-04-26T07:28:31.163472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172956+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:31.172956+0000","last_peered":"2024-04-26T07:28:31.172956+0000","last_clean":"2024-04-26T07:28:31.172956+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:31.172956+0000","last_undegraded":"2024-04-26T07:28:31.172956+0000","last_fullsized":"2024-04-26T07:28:31.172956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171600+0000","last_change":"2024-04-26T07:28:31.165065+0000","last_active":"2024-04-26T07:28:31.171600+0000","last_peered":"2024-04-26T07:28:31.171600+0000","last_clean":"2024-04-26T07:28:31.171600+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:28:31.171600+0000","last_undegraded":"2024-04-26T07:28:31.171600+0000","last_fullsized":"2024-04-26T07:28:31.171600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146168+0000","last_change":"2024-04-26T07:28:30.844998+0000","last_active":"2024-04-26T07:28:31.146168+0000","last_peered":"2024-04-26T07:28:31.146168+0000","last_clean":"2024-04-26T07:28:31.146168+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:28:31.146168+0000","last_undegraded":"2024-04-26T07:28:31.146168+0000","last_fullsized":"2024-04-26T07:28:31.146168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186075+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:31.186075+0000","last_peered":"2024-04-26T07:28:31.186075+0000","last_clean":"2024-04-26T07:28:31.186075+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:31.186075+0000","last_undegraded":"2024-04-26T07:28:31.186075+0000","last_fullsized":"2024-04-26T07:28:31.186075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163958+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:31.163958+0000","last_peered":"2024-04-26T07:28:31.163958+0000","last_clean":"2024-04-26T07:28:31.163958+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:31.163958+0000","last_undegraded":"2024-04-26T07:28:31.163958+0000","last_fullsized":"2024-04-26T07:28:31.163958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.169765+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:31.169765+0000","last_peered":"2024-04-26T07:28:31.169765+0000","last_clean":"2024-04-26T07:28:31.169765+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:31.169765+0000","last_undegraded":"2024-04-26T07:28:31.169765+0000","last_fullsized":"2024-04-26T07:28:31.169765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139999+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:31.139999+0000","last_peered":"2024-04-26T07:28:31.139999+0000","last_clean":"2024-04-26T07:28:31.139999+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:31.139999+0000","last_undegraded":"2024-04-26T07:28:31.139999+0000","last_fullsized":"2024-04-26T07:28:31.139999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162684+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:31.162684+0000","last_peered":"2024-04-26T07:28:31.162684+0000","last_clean":"2024-04-26T07:28:31.162684+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:31.162684+0000","last_undegraded":"2024-04-26T07:28:31.162684+0000","last_fullsized":"2024-04-26T07:28:31.162684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136564+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:31.136564+0000","last_peered":"2024-04-26T07:28:31.136564+0000","last_clean":"2024-04-26T07:28:31.136564+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:31.136564+0000","last_undegraded":"2024-04-26T07:28:31.136564+0000","last_fullsized":"2024-04-26T07:28:31.136564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172151+0000","last_change":"2024-04-26T07:28:31.164112+0000","last_active":"2024-04-26T07:28:31.172151+0000","last_peered":"2024-04-26T07:28:31.172151+0000","last_clean":"2024-04-26T07:28:31.172151+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:28:31.172151+0000","last_undegraded":"2024-04-26T07:28:31.172151+0000","last_fullsized":"2024-04-26T07:28:31.172151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136060+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:31.136060+0000","last_peered":"2024-04-26T07:28:31.136060+0000","last_clean":"2024-04-26T07:28:31.136060+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:31.136060+0000","last_undegraded":"2024-04-26T07:28:31.136060+0000","last_fullsized":"2024-04-26T07:28:31.136060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175642+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:31.175642+0000","last_peered":"2024-04-26T07:28:31.175642+0000","last_clean":"2024-04-26T07:28:31.175642+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:31.175642+0000","last_undegraded":"2024-04-26T07:28:31.175642+0000","last_fullsized":"2024-04-26T07:28:31.175642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.147037+0000","last_change":"2024-04-26T07:28:22.650334+0000","last_active":"2024-04-26T07:28:31.147037+0000","last_peered":"2024-04-26T07:28:31.147037+0000","last_clean":"2024-04-26T07:28:31.147037+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:28:31.147037+0000","last_undegraded":"2024-04-26T07:28:31.147037+0000","last_fullsized":"2024-04-26T07:28:31.147037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.147161+0000","last_change":"2024-04-26T07:28:30.851175+0000","last_active":"2024-04-26T07:28:31.147161+0000","last_peered":"2024-04-26T07:28:31.147161+0000","last_clean":"2024-04-26T07:28:31.147161+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:28:31.147161+0000","last_undegraded":"2024-04-26T07:28:31.147161+0000","last_fullsized":"2024-04-26T07:28:31.147161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174550+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:31.174550+0000","last_peered":"2024-04-26T07:28:31.174550+0000","last_clean":"2024-04-26T07:28:31.174550+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:31.174550+0000","last_undegraded":"2024-04-26T07:28:31.174550+0000","last_fullsized":"2024-04-26T07:28:31.174550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139938+0000","last_change":"2024-04-26T07:28:22.023450+0000","last_active":"2024-04-26T07:28:31.139938+0000","last_peered":"2024-04-26T07:28:31.139938+0000","last_clean":"2024-04-26T07:28:31.139938+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:28:31.139938+0000","last_undegraded":"2024-04-26T07:28:31.139938+0000","last_fullsized":"2024-04-26T07:28:31.139938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146363+0000","last_change":"2024-04-26T07:28:30.853616+0000","last_active":"2024-04-26T07:28:31.146363+0000","last_peered":"2024-04-26T07:28:31.146363+0000","last_clean":"2024-04-26T07:28:31.146363+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:28:31.146363+0000","last_undegraded":"2024-04-26T07:28:31.146363+0000","last_fullsized":"2024-04-26T07:28:31.146363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163132+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:31.163132+0000","last_peered":"2024-04-26T07:28:31.163132+0000","last_clean":"2024-04-26T07:28:31.163132+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:31.163132+0000","last_undegraded":"2024-04-26T07:28:31.163132+0000","last_fullsized":"2024-04-26T07:28:31.163132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146597+0000","last_change":"2024-04-26T07:28:22.024031+0000","last_active":"2024-04-26T07:28:31.146597+0000","last_peered":"2024-04-26T07:28:31.146597+0000","last_clean":"2024-04-26T07:28:31.146597+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:28:31.146597+0000","last_undegraded":"2024-04-26T07:28:31.146597+0000","last_fullsized":"2024-04-26T07:28:31.146597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140498+0000","last_change":"2024-04-26T07:28:30.839738+0000","last_active":"2024-04-26T07:28:31.140498+0000","last_peered":"2024-04-26T07:28:31.140498+0000","last_clean":"2024-04-26T07:28:31.140498+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:28:31.140498+0000","last_undegraded":"2024-04-26T07:28:31.140498+0000","last_fullsized":"2024-04-26T07:28:31.140498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186048+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:31.186048+0000","last_peered":"2024-04-26T07:28:31.186048+0000","last_clean":"2024-04-26T07:28:31.186048+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:31.186048+0000","last_undegraded":"2024-04-26T07:28:31.186048+0000","last_fullsized":"2024-04-26T07:28:31.186048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139873+0000","last_change":"2024-04-26T07:28:22.023795+0000","last_active":"2024-04-26T07:28:31.139873+0000","last_peered":"2024-04-26T07:28:31.139873+0000","last_clean":"2024-04-26T07:28:31.139873+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:28:31.139873+0000","last_undegraded":"2024-04-26T07:28:31.139873+0000","last_fullsized":"2024-04-26T07:28:31.139873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140354+0000","last_change":"2024-04-26T07:28:18.549478+0000","last_active":"2024-04-26T07:28:31.140354+0000","last_peered":"2024-04-26T07:28:31.140354+0000","last_clean":"2024-04-26T07:28:31.140354+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:28:31.140354+0000","last_undegraded":"2024-04-26T07:28:31.140354+0000","last_fullsized":"2024-04-26T07:28:31.140354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_clean_scrub_stamp":"2024-04-26T07:28:14.971410+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.135798+0000","last_change":"2024-04-26T07:28:30.859261+0000","last_active":"2024-04-26T07:28:31.135798+0000","last_peered":"2024-04-26T07:28:31.135798+0000","last_clean":"2024-04-26T07:28:31.135798+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:28:31.135798+0000","last_undegraded":"2024-04-26T07:28:31.135798+0000","last_fullsized":"2024-04-26T07:28:31.135798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179112+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:31.179112+0000","last_peered":"2024-04-26T07:28:31.179112+0000","last_clean":"2024-04-26T07:28:31.179112+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:31.179112+0000","last_undegraded":"2024-04-26T07:28:31.179112+0000","last_fullsized":"2024-04-26T07:28:31.179112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136584+0000","last_change":"2024-04-26T07:28:22.026306+0000","last_active":"2024-04-26T07:28:31.136584+0000","last_peered":"2024-04-26T07:28:31.136584+0000","last_clean":"2024-04-26T07:28:31.136584+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:28:31.136584+0000","last_undegraded":"2024-04-26T07:28:31.136584+0000","last_fullsized":"2024-04-26T07:28:31.136584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.165117+0000","last_change":"2024-04-26T07:28:30.854930+0000","last_active":"2024-04-26T07:28:31.165117+0000","last_peered":"2024-04-26T07:28:31.165117+0000","last_clean":"2024-04-26T07:28:31.165117+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:28:31.165117+0000","last_undegraded":"2024-04-26T07:28:31.165117+0000","last_fullsized":"2024-04-26T07:28:31.165117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186614+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:31.186614+0000","last_peered":"2024-04-26T07:28:31.186614+0000","last_clean":"2024-04-26T07:28:31.186614+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:31.186614+0000","last_undegraded":"2024-04-26T07:28:31.186614+0000","last_fullsized":"2024-04-26T07:28:31.186614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.149451+0000","last_change":"2024-04-26T07:28:22.650352+0000","last_active":"2024-04-26T07:28:31.149451+0000","last_peered":"2024-04-26T07:28:31.149451+0000","last_clean":"2024-04-26T07:28:31.149451+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:28:31.149451+0000","last_undegraded":"2024-04-26T07:28:31.149451+0000","last_fullsized":"2024-04-26T07:28:31.149451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140458+0000","last_change":"2024-04-26T07:28:30.844050+0000","last_active":"2024-04-26T07:28:31.140458+0000","last_peered":"2024-04-26T07:28:31.140458+0000","last_clean":"2024-04-26T07:28:31.140458+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:28:31.140458+0000","last_undegraded":"2024-04-26T07:28:31.140458+0000","last_fullsized":"2024-04-26T07:28:31.140458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180827+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:31.180827+0000","last_peered":"2024-04-26T07:28:31.180827+0000","last_clean":"2024-04-26T07:28:31.180827+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:31.180827+0000","last_undegraded":"2024-04-26T07:28:31.180827+0000","last_fullsized":"2024-04-26T07:28:31.180827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173344+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:31.173344+0000","last_peered":"2024-04-26T07:28:31.173344+0000","last_clean":"2024-04-26T07:28:31.173344+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:31.173344+0000","last_undegraded":"2024-04-26T07:28:31.173344+0000","last_fullsized":"2024-04-26T07:28:31.173344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140850+0000","last_change":"2024-04-26T07:28:22.650310+0000","last_active":"2024-04-26T07:28:31.140850+0000","last_peered":"2024-04-26T07:28:31.140850+0000","last_clean":"2024-04-26T07:28:31.140850+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:28:31.140850+0000","last_undegraded":"2024-04-26T07:28:31.140850+0000","last_fullsized":"2024-04-26T07:28:31.140850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172737+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:31.172737+0000","last_peered":"2024-04-26T07:28:31.172737+0000","last_clean":"2024-04-26T07:28:31.172737+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:31.172737+0000","last_undegraded":"2024-04-26T07:28:31.172737+0000","last_fullsized":"2024-04-26T07:28:31.172737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.142937+0000","last_change":"2024-04-26T07:28:22.650378+0000","last_active":"2024-04-26T07:28:31.142937+0000","last_peered":"2024-04-26T07:28:31.142937+0000","last_clean":"2024-04-26T07:28:31.142937+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:28:31.142937+0000","last_undegraded":"2024-04-26T07:28:31.142937+0000","last_fullsized":"2024-04-26T07:28:31.142937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142805+0000","last_change":"2024-04-26T07:28:30.848849+0000","last_active":"2024-04-26T07:28:32.142805+0000","last_peered":"2024-04-26T07:28:32.142805+0000","last_clean":"2024-04-26T07:28:32.142805+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:28:32.142805+0000","last_undegraded":"2024-04-26T07:28:32.142805+0000","last_fullsized":"2024-04-26T07:28:32.142805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172185+0000","last_change":"2024-04-26T07:28:31.160967+0000","last_active":"2024-04-26T07:28:31.172185+0000","last_peered":"2024-04-26T07:28:31.172185+0000","last_clean":"2024-04-26T07:28:31.172185+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:28:31.172185+0000","last_undegraded":"2024-04-26T07:28:31.172185+0000","last_fullsized":"2024-04-26T07:28:31.172185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178720+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:31.178720+0000","last_peered":"2024-04-26T07:28:31.178720+0000","last_clean":"2024-04-26T07:28:31.178720+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:31.178720+0000","last_undegraded":"2024-04-26T07:28:31.178720+0000","last_fullsized":"2024-04-26T07:28:31.178720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.161796+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:31.161796+0000","last_peered":"2024-04-26T07:28:31.161796+0000","last_clean":"2024-04-26T07:28:31.161796+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:31.161796+0000","last_undegraded":"2024-04-26T07:28:31.161796+0000","last_fullsized":"2024-04-26T07:28:31.161796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178894+0000","last_change":"2024-04-26T07:28:30.852699+0000","last_active":"2024-04-26T07:28:31.178894+0000","last_peered":"2024-04-26T07:28:31.178894+0000","last_clean":"2024-04-26T07:28:31.178894+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:28:31.178894+0000","last_undegraded":"2024-04-26T07:28:31.178894+0000","last_fullsized":"2024-04-26T07:28:31.178894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172388+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:31.172388+0000","last_peered":"2024-04-26T07:28:31.172388+0000","last_clean":"2024-04-26T07:28:31.172388+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:31.172388+0000","last_undegraded":"2024-04-26T07:28:31.172388+0000","last_fullsized":"2024-04-26T07:28:31.172388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.177540+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:31.177540+0000","last_peered":"2024-04-26T07:28:31.177540+0000","last_clean":"2024-04-26T07:28:31.177540+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:31.177540+0000","last_undegraded":"2024-04-26T07:28:31.177540+0000","last_fullsized":"2024-04-26T07:28:31.177540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171622+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:31.171622+0000","last_peered":"2024-04-26T07:28:31.171622+0000","last_clean":"2024-04-26T07:28:31.171622+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:31.171622+0000","last_undegraded":"2024-04-26T07:28:31.171622+0000","last_fullsized":"2024-04-26T07:28:31.171622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.156602+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:31.156602+0000","last_peered":"2024-04-26T07:28:31.156602+0000","last_clean":"2024-04-26T07:28:31.156602+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:31.156602+0000","last_undegraded":"2024-04-26T07:28:31.156602+0000","last_fullsized":"2024-04-26T07:28:31.156602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162955+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:31.162955+0000","last_peered":"2024-04-26T07:28:31.162955+0000","last_clean":"2024-04-26T07:28:31.162955+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:31.162955+0000","last_undegraded":"2024-04-26T07:28:31.162955+0000","last_fullsized":"2024-04-26T07:28:31.162955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187941+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:31.187941+0000","last_peered":"2024-04-26T07:28:31.187941+0000","last_clean":"2024-04-26T07:28:31.187941+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:31.187941+0000","last_undegraded":"2024-04-26T07:28:31.187941+0000","last_fullsized":"2024-04-26T07:28:31.187941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171434+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:31.171434+0000","last_peered":"2024-04-26T07:28:31.171434+0000","last_clean":"2024-04-26T07:28:31.171434+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:31.171434+0000","last_undegraded":"2024-04-26T07:28:31.171434+0000","last_fullsized":"2024-04-26T07:28:31.171434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.166241+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:31.166241+0000","last_peered":"2024-04-26T07:28:31.166241+0000","last_clean":"2024-04-26T07:28:31.166241+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:31.166241+0000","last_undegraded":"2024-04-26T07:28:31.166241+0000","last_fullsized":"2024-04-26T07:28:31.166241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162933+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:31.162933+0000","last_peered":"2024-04-26T07:28:31.162933+0000","last_clean":"2024-04-26T07:28:31.162933+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:31.162933+0000","last_undegraded":"2024-04-26T07:28:31.162933+0000","last_fullsized":"2024-04-26T07:28:31.162933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.169782+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:31.169782+0000","last_peered":"2024-04-26T07:28:31.169782+0000","last_clean":"2024-04-26T07:28:31.169782+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:31.169782+0000","last_undegraded":"2024-04-26T07:28:31.169782+0000","last_fullsized":"2024-04-26T07:28:31.169782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164315+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:31.164315+0000","last_peered":"2024-04-26T07:28:31.164315+0000","last_clean":"2024-04-26T07:28:31.164315+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:31.164315+0000","last_undegraded":"2024-04-26T07:28:31.164315+0000","last_fullsized":"2024-04-26T07:28:31.164315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173981+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:31.173981+0000","last_peered":"2024-04-26T07:28:31.173981+0000","last_clean":"2024-04-26T07:28:31.173981+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:31.173981+0000","last_undegraded":"2024-04-26T07:28:31.173981+0000","last_fullsized":"2024-04-26T07:28:31.173981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":52577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":52383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":51547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]}]}} 2024-04-26T07:28:35.924 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T07:28:35.924 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T07:28:35.925 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T07:28:35.925 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T07:28:35.925 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T07:28:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.065+0000 7f73867bb700 1 Processor -- start 2024-04-26T07:28:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.065+0000 7f73867bb700 1 -- start start 2024-04-26T07:28:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f73867bb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f738009c9e0 0x7f738009e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f73867bb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f738009f420 0x7f73800a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f73867bb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738009e2a0 con 0x7f73800a3170 2024-04-26T07:28:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f73867bb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738009ce70 con 0x7f738009f420 2024-04-26T07:28:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f73867bb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f738009d110 con 0x7f738009c9e0 2024-04-26T07:28:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f737f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f738009c9e0 0x7f738009e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f7384d58700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f738009f420 0x7f73800a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f737ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f73800a3170 0x7f73800a3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46606/0 (socket says 172.21.15.31:46606) 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f737f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f738009c9e0 0x7f738009e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40570/0 (socket says 172.21.15.31:40570) 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f7384d58700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f738009f420 0x7f73800a3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36742/0 (socket says 172.21.15.31:36742) 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f737ffff700 1 -- 172.21.15.31:0/3974702754 learned_addr learned my addr 172.21.15.31:0/3974702754 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f7384d58700 1 -- 172.21.15.31:0/3974702754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f738009c9e0 msgr2=0x7f738009e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f7384d58700 1 --2- 172.21.15.31:0/3974702754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f738009c9e0 0x7f738009e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f7384d58700 1 -- 172.21.15.31:0/3974702754 >> v1:172.21.15.31:6789/0 conn(0x7f73800a3170 legacy=0x7f73800a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f7384d58700 1 -- 172.21.15.31:0/3974702754 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738005c4e0 con 0x7f738009f420 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.066+0000 7f7384d58700 1 --2- 172.21.15.31:0/3974702754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 0x7f73800a3c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f73780032f0 tx=0x7f73780091d0).ready entity=mon.0 client_cookie=e6a667dc53435851 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f737effd700 1 -- 172.21.15.31:0/3974702754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f737800b6c0 con 0x7f738009f420 2024-04-26T07:28:36.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f737effd700 1 -- 172.21.15.31:0/3974702754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737800b820 con 0x7f738009f420 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f737effd700 1 -- 172.21.15.31:0/3974702754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f737800b990 con 0x7f738009f420 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f73867bb700 1 -- 172.21.15.31:0/3974702754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 msgr2=0x7f73800a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f73867bb700 1 --2- 172.21.15.31:0/3974702754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 0x7f73800a3c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f73780032f0 tx=0x7f73780091d0).stop 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f73867bb700 1 -- 172.21.15.31:0/3974702754 shutdown_connections 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f73867bb700 1 --2- 172.21.15.31:0/3974702754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 0x7f73800a3c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f73867bb700 1 --2- 172.21.15.31:0/3974702754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f738009c9e0 0x7f738009e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f73867bb700 1 -- 172.21.15.31:0/3974702754 >> 172.21.15.31:0/3974702754 conn(0x7f7380060ee0 msgr2=0x7f73800a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f73867bb700 1 -- 172.21.15.31:0/3974702754 shutdown_connections 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.067+0000 7f73867bb700 1 -- 172.21.15.31:0/3974702754 wait complete. 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.068+0000 7f73867bb700 1 Processor -- start 2024-04-26T07:28:36.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.068+0000 7f73867bb700 1 -- start start 2024-04-26T07:28:36.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f73867bb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 0x7f7380093300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f73867bb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73800a3170 0x7f7380148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f73867bb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f73800937f0 0x7f7380149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f73867bb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7380066210 con 0x7f738009f420 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f73867bb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73800928c0 con 0x7f73800a3170 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f73867bb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73800950c0 con 0x7f73800937f0 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 0x7f7380093300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73800a3170 0x7f7380148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73800a3170 0x7f7380148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39370/0 (socket says 172.21.15.31:39370) 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 -- 172.21.15.31:0/3862979332 learned_addr learned my addr 172.21.15.31:0/3862979332 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 0x7f7380093300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36750/0 (socket says 172.21.15.31:36750) 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f7384d58700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f73800937f0 0x7f7380149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 -- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f73800937f0 msgr2=0x7f7380149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 --2- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f73800937f0 0x7f7380149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 -- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 msgr2=0x7f7380093300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 --2- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 0x7f7380093300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 -- 172.21.15.31:0/3862979332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378009470 con 0x7f73800a3170 2024-04-26T07:28:36.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737f7fe700 1 --2- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73800a3170 0x7f7380148f60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f73800926f0 tx=0x7f7374008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737d7fa700 1 -- 172.21.15.31:0/3862979332 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f737400ba30 con 0x7f73800a3170 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f737d7fa700 1 -- 172.21.15.31:0/3862979332 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737400bb90 con 0x7f73800a3170 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.069+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7380094850 con 0x7f73800a3170 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.070+0000 7f737d7fa700 1 -- 172.21.15.31:0/3862979332 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7374010440 con 0x7f73800a3170 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.070+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7380092290 con 0x7f73800a3170 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.070+0000 7f737d7fa700 1 -- 172.21.15.31:0/3862979332 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f73740105a0 con 0x7f73800a3170 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.070+0000 7f737d7fa700 1 -- 172.21.15.31:0/3862979332 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f737404b0a0 con 0x7f73800a3170 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.071+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7380093170 con 0x7f73800a3170 2024-04-26T07:28:36.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.074+0000 7f737d7fa700 1 -- 172.21.15.31:0/3862979332 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f73740339d0 con 0x7f73800a3170 2024-04-26T07:28:36.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.210+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7380095b20 con 0x7f73800a3170 2024-04-26T07:28:36.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.212+0000 7f737d7fa700 1 -- 172.21.15.31:0/3862979332 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+84878 (secure 0 0 0) 0x7f73740337a0 con 0x7f73800a3170 2024-04-26T07:28:36.214 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:36.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.213+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 >> v1:172.21.15.31:6816/39613 conn(0x7f7360038da0 legacy=0x7f736003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.213+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73800a3170 msgr2=0x7f7380148f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.213+0000 7f73867bb700 1 --2- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73800a3170 0x7f7380148f60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f73800926f0 tx=0x7f7374008040).stop 2024-04-26T07:28:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.213+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 shutdown_connections 2024-04-26T07:28:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.213+0000 7f73867bb700 1 --2- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f73800937f0 0x7f7380149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.213+0000 7f73867bb700 1 --2- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f738009f420 0x7f7380093300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.213+0000 7f73867bb700 1 --2- 172.21.15.31:0/3862979332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73800a3170 0x7f7380148f60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.213+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 >> 172.21.15.31:0/3862979332 conn(0x7f7380060ee0 msgr2=0x7f738005dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.214+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 shutdown_connections 2024-04-26T07:28:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.214+0000 7f73867bb700 1 -- 172.21.15.31:0/3862979332 wait complete. 2024-04-26T07:28:36.225 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6816","nonce":39613}]},"active_addr":"172.21.15.31:6816/39613","active_change":"2024-04-26T07:28:13.969418+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1074568285}]},{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":730140214}]},{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2560283884}]}]}} 2024-04-26T07:28:36.227 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T07:28:36.227 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T07:28:36.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7c6167700 1 Processor -- start 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7c6167700 1 -- start start 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7c6167700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a22a0 0x7fb7c009c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7c6167700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7c00a2680 0x7fb7c00a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7c6167700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a3660 0x7fb7c00a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7c6167700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c00a4000 con 0x7fb7c00a2680 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7c6167700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c009d150 con 0x7fb7c00a3660 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7c6167700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c009dd80 con 0x7fb7c00a22a0 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7beffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7c00a2680 0x7fb7c00a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7bf7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a22a0 0x7fb7c009c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a3660 0x7fb7c00a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7beffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7c00a2680 0x7fb7c00a3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36758/0 (socket says 172.21.15.31:36758) 2024-04-26T07:28:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a3660 0x7fb7c00a3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39382/0 (socket says 172.21.15.31:39382) 2024-04-26T07:28:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7bf7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a22a0 0x7fb7c009c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40578/0 (socket says 172.21.15.31:40578) 2024-04-26T07:28:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.333+0000 7fb7beffd700 1 -- 172.21.15.31:0/4202935572 learned_addr learned my addr 172.21.15.31:0/4202935572 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7beffd700 1 -- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a22a0 msgr2=0x7fb7c009c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7beffd700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a22a0 0x7fb7c009c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7beffd700 1 -- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a3660 msgr2=0x7fb7c00a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7beffd700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a3660 0x7fb7c00a3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7beffd700 1 -- 172.21.15.31:0/4202935572 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c009ce90 con 0x7fb7c00a2680 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7bf7fe700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a22a0 0x7fb7c009c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7bffff700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a3660 0x7fb7c00a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7beffd700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a2680 0x7fb7c00a3170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb7a8002f70 tx=0x7fb7a8006eb0).ready entity=mon.0 client_cookie=fba25ad6d16e1b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7be7fc700 1 -- 172.21.15.31:0/4202935572 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a800d570 con 0x7fb7c00a2680 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7be7fc700 1 -- 172.21.15.31:0/4202935572 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a8000e90 con 0x7fb7c00a2680 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.334+0000 7fb7be7fc700 1 -- 172.21.15.31:0/4202935572 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a800d8c0 con 0x7fb7c00a2680 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 -- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a2680 msgr2=0x7fb7c00a3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a2680 0x7fb7c00a3170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb7a8002f70 tx=0x7fb7a8006eb0).stop 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 -- 172.21.15.31:0/4202935572 shutdown_connections 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a3660 0x7fb7c00a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a22a0 0x7fb7c009c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 --2- 172.21.15.31:0/4202935572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a2680 0x7fb7c00a3170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 -- 172.21.15.31:0/4202935572 >> 172.21.15.31:0/4202935572 conn(0x7fb7c0060ee0 msgr2=0x7fb7c00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 -- 172.21.15.31:0/4202935572 shutdown_connections 2024-04-26T07:28:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.335+0000 7fb7c6167700 1 -- 172.21.15.31:0/4202935572 wait complete. 2024-04-26T07:28:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7c6167700 1 Processor -- start 2024-04-26T07:28:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7c6167700 1 -- start start 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7c6167700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a22a0 0x7fb7c0133970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7c6167700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a2680 0x7fb7c01351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7c6167700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a3660 0x7fb7c0132760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7c6167700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c01356d0 con 0x7fb7c00a3660 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7c6167700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0062d30 con 0x7fb7c00a22a0 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7c6167700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0062ff0 con 0x7fb7c00a2680 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7bf7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a22a0 0x7fb7c0133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7beffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a2680 0x7fb7c01351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a3660 0x7fb7c0132760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7bf7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a22a0 0x7fb7c0133970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39398/0 (socket says 172.21.15.31:39398) 2024-04-26T07:28:36.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a3660 0x7fb7c0132760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36760/0 (socket says 172.21.15.31:36760) 2024-04-26T07:28:36.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.336+0000 7fb7bf7fe700 1 -- 172.21.15.31:0/50691325 learned_addr learned my addr 172.21.15.31:0/50691325 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bffff700 1 -- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a2680 msgr2=0x7fb7c01351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bffff700 1 --2- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a2680 0x7fb7c01351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bffff700 1 -- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a22a0 msgr2=0x7fb7c0133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bffff700 1 --2- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a22a0 0x7fb7c0133970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bffff700 1 -- 172.21.15.31:0/50691325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b0009470 con 0x7fb7c00a3660 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bf7fe700 1 --2- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a22a0 0x7fb7c0133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bffff700 1 --2- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a3660 0x7fb7c0132760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb7b800c000 tx=0x7fb7b8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bcff9700 1 -- 172.21.15.31:0/50691325 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7b8010780 con 0x7fb7c00a3660 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bcff9700 1 -- 172.21.15.31:0/50691325 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b80108e0 con 0x7fb7c00a3660 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b800b180 con 0x7fb7c00a3660 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7bcff9700 1 -- 172.21.15.31:0/50691325 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7b8010c40 con 0x7fb7c00a3660 2024-04-26T07:28:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.337+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a800b1e0 con 0x7fb7c00a3660 2024-04-26T07:28:36.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.338+0000 7fb7bcff9700 1 -- 172.21.15.31:0/50691325 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb7b801c460 con 0x7fb7c00a3660 2024-04-26T07:28:36.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.338+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c0062ab0 con 0x7fb7c00a3660 2024-04-26T07:28:36.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.338+0000 7fb7bcff9700 1 -- 172.21.15.31:0/50691325 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb7b804ac40 con 0x7fb7c00a3660 2024-04-26T07:28:36.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.341+0000 7fb7bcff9700 1 -- 172.21.15.31:0/50691325 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb7b8033570 con 0x7fb7c00a3660 2024-04-26T07:28:36.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.458+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7c006bbc0 con 0x7fb7c00a3660 2024-04-26T07:28:36.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.459+0000 7fb7bcff9700 1 -- 172.21.15.31:0/50691325 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7fb7b8033160 con 0x7fb7c00a3660 2024-04-26T07:28:36.460 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:36.460 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:32.133218+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:36.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 >> v1:172.21.15.31:6816/39613 conn(0x7fb7a4038e60 legacy=0x7fb7a403b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a3660 msgr2=0x7fb7c0132760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 --2- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a3660 0x7fb7c0132760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb7b800c000 tx=0x7fb7b8006df0).stop 2024-04-26T07:28:36.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 shutdown_connections 2024-04-26T07:28:36.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 --2- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7c00a3660 0x7fb7c0132760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 --2- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7c00a22a0 0x7fb7c0133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 --2- 172.21.15.31:0/50691325 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7c00a2680 0x7fb7c01351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 >> 172.21.15.31:0/50691325 conn(0x7fb7c0060ee0 msgr2=0x7fb7c00a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 shutdown_connections 2024-04-26T07:28:36.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.460+0000 7fb7c6167700 1 -- 172.21.15.31:0/50691325 wait complete. 2024-04-26T07:28:36.472 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T07:28:36.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:36.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.578+0000 7f86691ba700 1 Processor -- start 2024-04-26T07:28:36.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.578+0000 7f86691ba700 1 -- start start 2024-04-26T07:28:36.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.578+0000 7f86691ba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86640648b0 0x7f8664136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.578+0000 7f86691ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f86641337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.578+0000 7f86691ba700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866406cd70 con 0x7f866406c990 2024-04-26T07:28:36.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.578+0000 7f86691ba700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8664137340 con 0x7f86640648b0 2024-04-26T07:28:36.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.578+0000 7f86691ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8664132eb0 con 0x7f8664133340 2024-04-26T07:28:36.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86640648b0 0x7f8664136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f86641337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f86641337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39414/0 (socket says 172.21.15.31:39414) 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86640648b0 0x7f8664136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36766/0 (socket says 172.21.15.31:36766) 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866359e700 1 -- 172.21.15.31:0/3459421966 learned_addr learned my addr 172.21.15.31:0/3459421966 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f8662d9d700 1 --1- 172.21.15.31:0/3459421966 >> v1:172.21.15.31:6789/0 conn(0x7f866406c990 0x7f8664136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46616/0 (socket says 172.21.15.31:46616) 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866359e700 1 -- 172.21.15.31:0/3459421966 >> v2:172.21.15.31:3300/0 conn(0x7f86640648b0 msgr2=0x7f8664136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866359e700 1 --2- 172.21.15.31:0/3459421966 >> v2:172.21.15.31:3300/0 conn(0x7f86640648b0 0x7f8664136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866359e700 1 -- 172.21.15.31:0/3459421966 >> v1:172.21.15.31:6789/0 conn(0x7f866406c990 legacy=0x7f8664136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f8661d9b700 1 -- 172.21.15.31:0/3459421966 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242377777 0 0) 0x7f866406cd70 con 0x7f866406c990 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866359e700 1 -- 172.21.15.31:0/3459421966 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664063c00 con 0x7f8664133340 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866259c700 1 --2- 172.21.15.31:0/3459421966 >> v2:172.21.15.31:3300/0 conn(0x7f86640648b0 0x7f8664136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f866359e700 1 --2- 172.21.15.31:0/3459421966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f86641337a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f86640a9bc0 tx=0x7f865c009290).ready entity=mon.1 client_cookie=1945d6b40b0e879b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f8661d9b700 1 -- 172.21.15.31:0/3459421966 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865c00b860 con 0x7f8664133340 2024-04-26T07:28:36.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f8661d9b700 1 -- 172.21.15.31:0/3459421966 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c00b9c0 con 0x7f8664133340 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.579+0000 7f8661d9b700 1 -- 172.21.15.31:0/3459421966 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865c00bb30 con 0x7f8664133340 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.580+0000 7f86691ba700 1 -- 172.21.15.31:0/3459421966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 msgr2=0x7f86641337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.580+0000 7f86691ba700 1 --2- 172.21.15.31:0/3459421966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f86641337a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f86640a9bc0 tx=0x7f865c009290).stop 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.580+0000 7f86691ba700 1 -- 172.21.15.31:0/3459421966 shutdown_connections 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.580+0000 7f86691ba700 1 --2- 172.21.15.31:0/3459421966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f86641337a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.580+0000 7f86691ba700 1 --2- 172.21.15.31:0/3459421966 >> v2:172.21.15.31:3300/0 conn(0x7f86640648b0 0x7f8664136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.580+0000 7f86691ba700 1 -- 172.21.15.31:0/3459421966 >> 172.21.15.31:0/3459421966 conn(0x7f8664061370 msgr2=0x7f866406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.580+0000 7f86691ba700 1 -- 172.21.15.31:0/3459421966 shutdown_connections 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.580+0000 7f86691ba700 1 -- 172.21.15.31:0/3459421966 wait complete. 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.581+0000 7f86691ba700 1 Processor -- start 2024-04-26T07:28:36.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.581+0000 7f86691ba700 1 -- start start 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f86691ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86640648b0 0x7f86640988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f86691ba700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866406c990 0x7f866412fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f86691ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f866412ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f86691ba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664098de0 con 0x7f86640648b0 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f86691ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866405b970 con 0x7f8664133340 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f86691ba700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86640982d0 con 0x7f866406c990 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f866412ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866406c990 0x7f866412fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866406c990 0x7f866412fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40592/0 (socket says 172.21.15.31:40592) 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f866412ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39422/0 (socket says 172.21.15.31:39422) 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 -- 172.21.15.31:0/345189571 learned_addr learned my addr 172.21.15.31:0/345189571 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f8662d9d700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86640648b0 0x7f86640988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 -- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 msgr2=0x7f866412ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f866412ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 -- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86640648b0 msgr2=0x7f86640988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86640648b0 0x7f86640988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 -- 172.21.15.31:0/345189571 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865800b180 con 0x7f866406c990 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f8662d9d700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86640648b0 0x7f86640988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866359e700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f866412ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f866259c700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866406c990 0x7f866412fa20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f86641380a0 tx=0x7f8658006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f8653fff700 1 -- 172.21.15.31:0/345189571 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865800c6a0 con 0x7f866406c990 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f8653fff700 1 -- 172.21.15.31:0/345189571 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865800c800 con 0x7f866406c990 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c009530 con 0x7f866406c990 2024-04-26T07:28:36.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f8653fff700 1 -- 172.21.15.31:0/345189571 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865800cb60 con 0x7f866406c990 2024-04-26T07:28:36.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.582+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8664137830 con 0x7f866406c990 2024-04-26T07:28:36.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.583+0000 7f8653fff700 1 -- 172.21.15.31:0/345189571 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f865800ccc0 con 0x7f866406c990 2024-04-26T07:28:36.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.583+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866406bbc0 con 0x7f866406c990 2024-04-26T07:28:36.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.584+0000 7f8653fff700 1 -- 172.21.15.31:0/345189571 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f865804ae10 con 0x7f866406c990 2024-04-26T07:28:36.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.587+0000 7f8653fff700 1 -- 172.21.15.31:0/345189571 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f86580302c0 con 0x7f866406c990 2024-04-26T07:28:36.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.706+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8664134530 con 0x7f866406c990 2024-04-26T07:28:36.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.707+0000 7f8653fff700 1 -- 172.21.15.31:0/345189571 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f8658033330 con 0x7f866406c990 2024-04-26T07:28:36.707 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:36.707 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:32.133218+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 >> v1:172.21.15.31:6816/39613 conn(0x7f8640038f50 legacy=0x7f864003b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866406c990 msgr2=0x7f866412fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866406c990 0x7f866412fa20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f86641380a0 tx=0x7f8658006df0).stop 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 shutdown_connections 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8664133340 0x7f866412ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86640648b0 0x7f86640988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 --2- 172.21.15.31:0/345189571 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866406c990 0x7f866412fa20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 >> 172.21.15.31:0/345189571 conn(0x7f8664061370 msgr2=0x7f8664134860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 shutdown_connections 2024-04-26T07:28:36.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.708+0000 7f86691ba700 1 -- 172.21.15.31:0/345189571 wait complete. 2024-04-26T07:28:36.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T07:28:36.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T07:28:36.721 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T07:28:36.721 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T07:28:36.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.837+0000 7f99f425c700 1 Processor -- start 2024-04-26T07:28:36.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.837+0000 7f99f425c700 1 -- start start 2024-04-26T07:28:36.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.837+0000 7fc3cf083700 1 Processor -- start 2024-04-26T07:28:36.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cf083700 1 -- start start 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f425c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99ec0acb40 0x7f99ec0acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f425c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec05cd00 0x7f99ec05d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f425c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec0ac450 con 0x7f99ec139680 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f425c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec05c870 con 0x7f99ec0acb40 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f425c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0ac6f0 con 0x7f99ec05cd00 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f17f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec05cd00 0x7f99ec05d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f17f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec05cd00 0x7f99ec05d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39438/0 (socket says 172.21.15.31:39438) 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f17f7700 1 -- 172.21.15.31:0/3159875840 learned_addr learned my addr 172.21.15.31:0/3159875840 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cf083700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c80679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f17f7700 1 -- 172.21.15.31:0/3159875840 >> v2:172.21.15.31:3300/0 conn(0x7f99ec0acb40 msgr2=0x7f99ec0acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f17f7700 1 --2- 172.21.15.31:0/3159875840 >> v2:172.21.15.31:3300/0 conn(0x7f99ec0acb40 0x7f99ec0acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f17f7700 1 -- 172.21.15.31:0/3159875840 >> v1:172.21.15.31:6789/0 conn(0x7f99ec139680 legacy=0x7f99ec139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cf083700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c813ea20 0x7fc3c8140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cf083700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c8067ec0 con 0x7fc3c81339b0 2024-04-26T07:28:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cf083700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80670c0 con 0x7fc3c813ea20 2024-04-26T07:28:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cf083700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8066600 con 0x7fc3c81335d0 2024-04-26T07:28:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cce1f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c80679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cce1f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c80679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40606/0 (socket says 172.21.15.31:40606) 2024-04-26T07:28:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7fc3cce1f700 1 -- 172.21.15.31:0/1715613312 learned_addr learned my addr 172.21.15.31:0/1715613312 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.838+0000 7f99f17f7700 1 -- 172.21.15.31:0/3159875840 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec05d910 con 0x7f99ec05cd00 2024-04-26T07:28:36.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3cd620700 1 --2- 172.21.15.31:0/1715613312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c813ea20 0x7fc3c8140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7f99f17f7700 1 --2- 172.21.15.31:0/3159875840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec05cd00 0x7f99ec05d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f99ec05c440 tx=0x7f99dc006eb0).ready entity=mon.1 client_cookie=f09943f5fa18500a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7f99f0ff6700 1 -- 172.21.15.31:0/3159875840 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99dc00d570 con 0x7f99ec05cd00 2024-04-26T07:28:36.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7f99f0ff6700 1 -- 172.21.15.31:0/3159875840 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc000e90 con 0x7f99ec05cd00 2024-04-26T07:28:36.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7f99f0ff6700 1 -- 172.21.15.31:0/3159875840 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99dc00d8c0 con 0x7f99ec05cd00 2024-04-26T07:28:36.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3cce1f700 1 -- 172.21.15.31:0/1715613312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c813ea20 msgr2=0x7fc3c8140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3cce1f700 1 --2- 172.21.15.31:0/1715613312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c813ea20 0x7fc3c8140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3cce1f700 1 -- 172.21.15.31:0/1715613312 >> v1:172.21.15.31:6789/0 conn(0x7fc3c81339b0 legacy=0x7fc3c80a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3cce1f700 1 -- 172.21.15.31:0/1715613312 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8066de0 con 0x7fc3c81335d0 2024-04-26T07:28:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3cce1f700 1 --2- 172.21.15.31:0/1715613312 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c80679d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc3c805caf0 tx=0x7fc3bc006eb0).ready entity=mon.2 client_cookie=d8f5e9be8db57b9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3c77fe700 1 -- 172.21.15.31:0/1715613312 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3bc00d570 con 0x7fc3c81335d0 2024-04-26T07:28:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3c77fe700 1 -- 172.21.15.31:0/1715613312 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc000e90 con 0x7fc3c81335d0 2024-04-26T07:28:36.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.839+0000 7fc3c77fe700 1 -- 172.21.15.31:0/1715613312 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3bc00d900 con 0x7fc3c81335d0 2024-04-26T07:28:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7f99f425c700 1 -- 172.21.15.31:0/3159875840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec05cd00 msgr2=0x7f99ec05d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7f99f425c700 1 --2- 172.21.15.31:0/3159875840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec05cd00 0x7f99ec05d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f99ec05c440 tx=0x7f99dc006eb0).stop 2024-04-26T07:28:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7f99f425c700 1 -- 172.21.15.31:0/3159875840 shutdown_connections 2024-04-26T07:28:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7f99f425c700 1 --2- 172.21.15.31:0/3159875840 >> v2:172.21.15.31:3300/0 conn(0x7f99ec0acb40 0x7f99ec0acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7f99f425c700 1 --2- 172.21.15.31:0/3159875840 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec05cd00 0x7f99ec05d100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7f99f425c700 1 -- 172.21.15.31:0/3159875840 >> 172.21.15.31:0/3159875840 conn(0x7f99ec061570 msgr2=0x7f99ec066b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7f99f425c700 1 -- 172.21.15.31:0/3159875840 shutdown_connections 2024-04-26T07:28:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7f99f425c700 1 -- 172.21.15.31:0/3159875840 wait complete. 2024-04-26T07:28:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7fc3cf083700 1 -- 172.21.15.31:0/1715613312 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 msgr2=0x7fc3c80679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.840+0000 7fc3cf083700 1 --2- 172.21.15.31:0/1715613312 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c80679d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc3c805caf0 tx=0x7fc3bc006eb0).stop 2024-04-26T07:28:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.841+0000 7fc3cf083700 1 -- 172.21.15.31:0/1715613312 shutdown_connections 2024-04-26T07:28:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.841+0000 7fc3cf083700 1 --2- 172.21.15.31:0/1715613312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c813ea20 0x7fc3c8140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.841+0000 7fc3cf083700 1 --2- 172.21.15.31:0/1715613312 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c80679d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.841+0000 7fc3cf083700 1 -- 172.21.15.31:0/1715613312 >> 172.21.15.31:0/1715613312 conn(0x7fc3c8060ee0 msgr2=0x7fc3c80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.841+0000 7fc3cf083700 1 -- 172.21.15.31:0/1715613312 shutdown_connections 2024-04-26T07:28:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.841+0000 7fc3cf083700 1 -- 172.21.15.31:0/1715613312 wait complete. 2024-04-26T07:28:36.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.841+0000 7f99f425c700 1 Processor -- start 2024-04-26T07:28:36.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.841+0000 7f99f425c700 1 -- start start 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7fc3cf083700 1 Processor -- start 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7fc3cf083700 1 -- start start 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cf083700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c809ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cf083700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c81339b0 0x7fc3c812c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cf083700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c813ea20 0x7fc3c812c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cf083700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80a08d0 con 0x7fc3c81339b0 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cf083700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c812cdd0 con 0x7fc3c813ea20 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cf083700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c812cf90 con 0x7fc3c81335d0 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cce1f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c809ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cce1f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c809ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40614/0 (socket says 172.21.15.31:40614) 2024-04-26T07:28:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cce1f700 1 -- 172.21.15.31:0/3232346267 learned_addr learned my addr 172.21.15.31:0/3232346267 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3c7fff700 1 --2- 172.21.15.31:0/3232346267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c81339b0 0x7fc3c812c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cce1f700 1 -- 172.21.15.31:0/3232346267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c813ea20 msgr2=0x7fc3c812c8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T07:28:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cce1f700 1 --2- 172.21.15.31:0/3232346267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3c813ea20 0x7fc3c812c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cce1f700 1 -- 172.21.15.31:0/3232346267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c81339b0 msgr2=0x7fc3c812c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cce1f700 1 --2- 172.21.15.31:0/3232346267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c81339b0 0x7fc3c812c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.843+0000 7fc3cce1f700 1 -- 172.21.15.31:0/3232346267 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc00b1e0 con 0x7fc3c81335d0 2024-04-26T07:28:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.844+0000 7fc3cce1f700 1 --2- 172.21.15.31:0/3232346267 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c809ff00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc3c805caf0 tx=0x7fc3bc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f425c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ec05cd00 0x7f99ec0a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f425c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec0acb40 0x7f99ec145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f425c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f99ec139680 0x7f99ec146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f425c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec115480 con 0x7f99ec05cd00 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f425c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec115210 con 0x7f99ec0acb40 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f425c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec145c50 con 0x7f99ec139680 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f1ff8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ec05cd00 0x7f99ec0a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f1ff8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ec05cd00 0x7f99ec0a5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36784/0 (socket says 172.21.15.31:36784) 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f1ff8700 1 -- 172.21.15.31:0/1959976754 learned_addr learned my addr 172.21.15.31:0/1959976754 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f1ff8700 1 -- 172.21.15.31:0/1959976754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f99ec139680 msgr2=0x7f99ec146450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f1ff8700 1 --2- 172.21.15.31:0/1959976754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f99ec139680 0x7f99ec146450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f1ff8700 1 -- 172.21.15.31:0/1959976754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec0acb40 msgr2=0x7f99ec145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f1ff8700 1 --2- 172.21.15.31:0/1959976754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99ec0acb40 0x7f99ec145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.842+0000 7f99f1ff8700 1 -- 172.21.15.31:0/1959976754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc00b1e0 con 0x7f99ec05cd00 2024-04-26T07:28:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7f99f1ff8700 1 --2- 172.21.15.31:0/1959976754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ec05cd00 0x7f99ec0a5f50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f99e8002f70 tx=0x7f99e8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3bc006b60 con 0x7fc3c81335d0 2024-04-26T07:28:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc002f50 con 0x7fc3c81335d0 2024-04-26T07:28:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3bc011e20 con 0x7fc3c81335d0 2024-04-26T07:28:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e8013460 con 0x7f99ec05cd00 2024-04-26T07:28:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e80135c0 con 0x7f99ec05cd00 2024-04-26T07:28:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e8013920 con 0x7f99ec05cd00 2024-04-26T07:28:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec114070 con 0x7f99ec05cd00 2024-04-26T07:28:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.845+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec132dc0 con 0x7f99ec05cd00 2024-04-26T07:28:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.846+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99ec114d70 con 0x7f99ec05cd00 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.847+0000 7fa3a353c700 1 Processor -- start 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.847+0000 7fa3a353c700 1 -- start start 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a353c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 0x7fa39c136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a353c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa39c133340 0x7fa39c1337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a353c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c06cd70 con 0x7fa39c06c990 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a353c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c137340 con 0x7fa39c133340 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a353c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c132eb0 con 0x7fa39c0648b0 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.846+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c8131570 con 0x7fc3c81335d0 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.846+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c80a2b10 con 0x7fc3c81335d0 2024-04-26T07:28:36.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.847+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3c809fc60 con 0x7fc3c81335d0 2024-04-26T07:28:36.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a12d8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa39c06c990 0x7fa39c136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46632/0 (socket says 172.21.15.31:46632) 2024-04-26T07:28:36.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a12d8700 1 -- 172.21.15.31:0/3756984419 learned_addr learned my addr 172.21.15.31:0/3756984419 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:36.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a1ad9700 1 --2- 172.21.15.31:0/3756984419 >> v2:172.21.15.31:3300/0 conn(0x7fa39c133340 0x7fa39c1337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a1ad9700 1 -- 172.21.15.31:0/3756984419 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 msgr2=0x7fa39c136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a1ad9700 1 --2- 172.21.15.31:0/3756984419 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 0x7fa39c136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a1ad9700 1 -- 172.21.15.31:0/3756984419 >> v1:172.21.15.31:6789/0 conn(0x7fa39c06c990 legacy=0x7fa39c136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a1ad9700 1 -- 172.21.15.31:0/3756984419 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c063c00 con 0x7fa39c133340 2024-04-26T07:28:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.848+0000 7fa3a1ad9700 1 --2- 172.21.15.31:0/3756984419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c133340 0x7fa39c1337a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa38c002f70 tx=0x7fa38c006df0).ready entity=mon.0 client_cookie=fce53bf7e7f7133b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f99e800f070 con 0x7f99ec05cd00 2024-04-26T07:28:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f99e804aa70 con 0x7f99ec05cd00 2024-04-26T07:28:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 --> v1:172.21.15.31:6800/40242 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99cc045610 con 0x7f99cc0419c0 2024-04-26T07:28:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99e804ae50 con 0x7f99ec05cd00 2024-04-26T07:28:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc3bc02e070 con 0x7fc3c81335d0 2024-04-26T07:28:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc3bc04c360 con 0x7fc3c81335d0 2024-04-26T07:28:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 --> v1:172.21.15.31:6804/40243 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3a8045580 con 0x7fc3a8041890 2024-04-26T07:28:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7f3749b24700 1 Processor -- start 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7fa38bfff700 1 -- 172.21.15.31:0/3756984419 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38c00d570 con 0x7fa39c133340 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7fa38bfff700 1 -- 172.21.15.31:0/3756984419 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c000e90 con 0x7fa39c133340 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7fa38bfff700 1 -- 172.21.15.31:0/3756984419 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38c00d8c0 con 0x7fa39c133340 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fa3a353c700 1 -- 172.21.15.31:0/3756984419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c133340 msgr2=0x7fa39c1337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fa3a353c700 1 --2- 172.21.15.31:0/3756984419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c133340 0x7fa39c1337a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa38c002f70 tx=0x7fa38c006df0).stop 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fa3a353c700 1 -- 172.21.15.31:0/3756984419 shutdown_connections 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fa3a353c700 1 --2- 172.21.15.31:0/3756984419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c133340 0x7fa39c1337a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fa3a353c700 1 --2- 172.21.15.31:0/3756984419 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 0x7fa39c136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fa3a353c700 1 -- 172.21.15.31:0/3756984419 >> 172.21.15.31:0/3756984419 conn(0x7fa39c061370 msgr2=0x7fa39c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fa3a353c700 1 -- 172.21.15.31:0/3756984419 shutdown_connections 2024-04-26T07:28:36.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 <== osd.3 v1:172.21.15.31:6804/40243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fc3a8045580 con 0x7fc3a8041890 2024-04-26T07:28:36.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.849+0000 7f3749b24700 1 -- start start 2024-04-26T07:28:36.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7f3749b24700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440986c0 0x7f3744092fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7f3749b24700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37440934d0 0x7f3744098aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7f3749b24700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3744098f90 0x7f3744135800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7f3749b24700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37440939b0 con 0x7f3744098f90 2024-04-26T07:28:36.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7f3749b24700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37440950f0 con 0x7f37440934d0 2024-04-26T07:28:36.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7f3749b24700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3744095450 con 0x7f37440986c0 2024-04-26T07:28:36.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f3743fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3744098f90 0x7f3744135800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f3743fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3744098f90 0x7f3744135800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36808/0 (socket says 172.21.15.31:36808) 2024-04-26T07:28:36.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f3743fff700 1 -- 172.21.15.31:0/146001606 learned_addr learned my addr 172.21.15.31:0/146001606 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 <== osd.0 v1:172.21.15.31:6800/40242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f99cc045610 con 0x7f99cc0419c0 2024-04-26T07:28:36.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f3743fff700 1 -- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440986c0 msgr2=0x7f3744092fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f3743fff700 1 --2- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440986c0 0x7f3744092fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f3743fff700 1 -- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37440934d0 msgr2=0x7f3744098aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:36.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f3743fff700 1 --2- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37440934d0 0x7f3744098aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7f3743fff700 1 -- 172.21.15.31:0/146001606 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374409a6b0 con 0x7f3744098f90 2024-04-26T07:28:36.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3bc012580 con 0x7fc3c81335d0 2024-04-26T07:28:36.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.850+0000 7fa3a353c700 1 -- 172.21.15.31:0/3756984419 wait complete. 2024-04-26T07:28:36.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7fa3a353c700 1 Processor -- start 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.851+0000 7fa3a353c700 1 -- start start 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.852+0000 7fa3a353c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 0x7fa39c0936d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.852+0000 7fa3a353c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa39c06c990 0x7fa39c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.852+0000 7fa3a353c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c133340 0x7fa39c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.852+0000 7fa3a353c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c094f60 con 0x7fa39c133340 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.852+0000 7fa3a353c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c066a20 con 0x7fa39c06c990 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.852+0000 7fa3a353c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c098ec0 con 0x7fa39c0648b0 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.852+0000 7fa3a12d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 0x7fa39c0936d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a12d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 0x7fa39c0936d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40634/0 (socket says 172.21.15.31:40634) 2024-04-26T07:28:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a12d8700 1 -- 172.21.15.31:0/2819413953 learned_addr learned my addr 172.21.15.31:0/2819413953 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7f3743fff700 1 --2- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744098f90 0x7f3744135800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f373c0032f0 tx=0x7f373c009b20).ready entity=mon.0 client_cookie=aa8ba3a6411dfc1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a0ad7700 1 --2- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa39c06c990 0x7fa39c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a1ad9700 1 --2- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c133340 0x7fa39c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a12d8700 1 -- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa39c06c990 msgr2=0x7fa39c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a12d8700 1 --2- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa39c06c990 0x7fa39c156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a12d8700 1 -- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c133340 msgr2=0x7fa39c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a12d8700 1 --2- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa39c133340 0x7fa39c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a12d8700 1 -- 172.21.15.31:0/2819413953 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c00b180 con 0x7fa39c0648b0 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.853+0000 7fa3a12d8700 1 --2- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 0x7fa39c0936d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa39c064c90 tx=0x7fa398007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa39800ce30 con 0x7fa39c0648b0 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980072e0 con 0x7fa39c0648b0 2024-04-26T07:28:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa398005800 con 0x7fa39c0648b0 2024-04-26T07:28:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7f3742ffd700 1 -- 172.21.15.31:0/146001606 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373c00cba0 con 0x7f3744098f90 2024-04-26T07:28:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7f3742ffd700 1 -- 172.21.15.31:0/146001606 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c00cd00 con 0x7f3744098f90 2024-04-26T07:28:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7f3742ffd700 1 -- 172.21.15.31:0/146001606 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373c010600 con 0x7f3744098f90 2024-04-26T07:28:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7f3749b24700 1 -- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744098f90 msgr2=0x7f3744135800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7f3749b24700 1 --2- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744098f90 0x7f3744135800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f373c0032f0 tx=0x7f373c009b20).stop 2024-04-26T07:28:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.854+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c092330 con 0x7fa39c0648b0 2024-04-26T07:28:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.855+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c094710 con 0x7fa39c0648b0 2024-04-26T07:28:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.855+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa39c095e40 con 0x7fa39c0648b0 2024-04-26T07:28:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa398010070 con 0x7fa39c0648b0 2024-04-26T07:28:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7f3749b24700 1 -- 172.21.15.31:0/146001606 shutdown_connections 2024-04-26T07:28:36.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7f3749b24700 1 --2- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744098f90 0x7f3744135800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:36.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7f3749b24700 1 --2- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440986c0 0x7f3744092fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7f3749b24700 1 --2- 172.21.15.31:0/146001606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37440934d0 0x7f3744098aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7f3749b24700 1 -- 172.21.15.31:0/146001606 >> 172.21.15.31:0/146001606 conn(0x7f374405bfc0 msgr2=0x7f374406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7f3749b24700 1 -- 172.21.15.31:0/146001606 shutdown_connections 2024-04-26T07:28:36.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7f3749b24700 1 -- 172.21.15.31:0/146001606 wait complete. 2024-04-26T07:28:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa398007450 con 0x7fa39c0648b0 2024-04-26T07:28:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 --> v1:172.21.15.31:6808/40241 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa37c045620 con 0x7fa37c0419d0 2024-04-26T07:28:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.856+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa39802ed90 con 0x7fa39c0648b0 2024-04-26T07:28:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.857+0000 7f3749b24700 1 Processor -- start 2024-04-26T07:28:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.857+0000 7f3749b24700 1 -- start start 2024-04-26T07:28:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f3749b24700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440934d0 0x7f3744133790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f3749b24700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37440986c0 0x7f37440a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f3749b24700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744098f90 0x7f37440a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:36.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f3749b24700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37440a5680 con 0x7f3744098f90 2024-04-26T07:28:36.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f3749b24700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3744135140 con 0x7f37440986c0 2024-04-26T07:28:36.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f3749b24700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3744133db0 con 0x7f37440934d0 2024-04-26T07:28:36.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440934d0 0x7f3744133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:36.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440934d0 0x7f3744133790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40650/0 (socket says 172.21.15.31:40650) 2024-04-26T07:28:36.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 -- 172.21.15.31:0/3693141688 learned_addr learned my addr 172.21.15.31:0/3693141688 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 -- 172.21.15.31:0/3693141688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37440986c0 msgr2=0x7f37440a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 --2- 172.21.15.31:0/3693141688 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37440986c0 0x7f37440a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 -- 172.21.15.31:0/3693141688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744098f90 msgr2=0x7f37440a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 --2- 172.21.15.31:0/3693141688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3744098f90 0x7f37440a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 -- 172.21.15.31:0/3693141688 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c009dc0 con 0x7f37440934d0 2024-04-26T07:28:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37437fe700 1 --2- 172.21.15.31:0/3693141688 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440934d0 0x7f3744133790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f372c002f70 tx=0x7f372c006e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37417fa700 1 -- 172.21.15.31:0/3693141688 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372c013460 con 0x7f37440934d0 2024-04-26T07:28:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f37417fa700 1 -- 172.21.15.31:0/3693141688 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c0135c0 con 0x7f37440934d0 2024-04-26T07:28:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3744134070 con 0x7f37440934d0 2024-04-26T07:28:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.858+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3744135750 con 0x7f37440934d0 2024-04-26T07:28:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.859+0000 7f37417fa700 1 -- 172.21.15.31:0/3693141688 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372c013920 con 0x7f37440934d0 2024-04-26T07:28:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.859+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 <== osd.1 v1:172.21.15.31:6808/40241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fa37c045620 con 0x7fa37c0419d0 2024-04-26T07:28:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.860+0000 7f37417fa700 1 -- 172.21.15.31:0/3693141688 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f372c01a060 con 0x7f37440934d0 2024-04-26T07:28:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.860+0000 7f37417fa700 1 -- 172.21.15.31:0/3693141688 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f372c04a1b0 con 0x7f37440934d0 2024-04-26T07:28:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.860+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 --> v1:172.21.15.31:6812/40244 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f371c0053e0 con 0x7f371c0015f0 2024-04-26T07:28:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.863+0000 7f37417fa700 1 -- 172.21.15.31:0/3693141688 <== osd.2 v1:172.21.15.31:6812/40244 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f371c0053e0 con 0x7f371c0015f0 2024-04-26T07:28:36.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.870+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 --> v1:172.21.15.31:6800/40242 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99ec06bbc0 con 0x7f99cc0419c0 2024-04-26T07:28:36.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99daffd700 1 -- 172.21.15.31:0/1959976754 <== osd.0 v1:172.21.15.31:6800/40242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f99ec06bbc0 con 0x7f99cc0419c0 2024-04-26T07:28:36.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 >> v1:172.21.15.31:6800/40242 conn(0x7f99cc0419c0 legacy=0x7f99cc043e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 >> v1:172.21.15.31:6816/39613 conn(0x7f99cc038ef0 legacy=0x7f99cc03b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ec05cd00 msgr2=0x7f99ec0a5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f425c700 1 --2- 172.21.15.31:0/1959976754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ec05cd00 0x7f99ec0a5f50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f99e8002f70 tx=0x7f99e8006ec0).stop 2024-04-26T07:28:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f27f9700 1 -- 172.21.15.31:0/1959976754 reap_dead start 2024-04-26T07:28:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 shutdown_connections 2024-04-26T07:28:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 >> 172.21.15.31:0/1959976754 conn(0x7f99ec061570 msgr2=0x7f99ec1353c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 shutdown_connections 2024-04-26T07:28:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.871+0000 7f99f425c700 1 -- 172.21.15.31:0/1959976754 wait complete. 2024-04-26T07:28:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.875+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 --> v1:172.21.15.31:6808/40241 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa39c06bbc0 con 0x7fa37c0419d0 2024-04-26T07:28:36.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.876+0000 7fa38a7fc700 1 -- 172.21.15.31:0/2819413953 <== osd.1 v1:172.21.15.31:6808/40241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fa39c06bbc0 con 0x7fa37c0419d0 2024-04-26T07:28:36.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.876+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 >> v1:172.21.15.31:6808/40241 conn(0x7fa37c0419d0 legacy=0x7fa37c043e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.876+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 >> v1:172.21.15.31:6816/39613 conn(0x7fa37c038f80 legacy=0x7fa37c03b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.876+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 msgr2=0x7fa39c0936d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.876+0000 7fa3a353c700 1 --2- 172.21.15.31:0/2819413953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa39c0648b0 0x7fa39c0936d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa39c064c90 tx=0x7fa398007c40).stop 2024-04-26T07:28:36.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.876+0000 7fa3a1ad9700 1 -- 172.21.15.31:0/2819413953 reap_dead start 2024-04-26T07:28:36.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.876+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 shutdown_connections 2024-04-26T07:28:36.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.876+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 >> 172.21.15.31:0/2819413953 conn(0x7fa39c061370 msgr2=0x7fa39c131ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.877+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 --> v1:172.21.15.31:6804/40243 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3c8135760 con 0x7fc3a8041890 2024-04-26T07:28:36.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.877+0000 7fc3c5ffb700 1 -- 172.21.15.31:0/3232346267 <== osd.3 v1:172.21.15.31:6804/40243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fc3c8135760 con 0x7fc3a8041890 2024-04-26T07:28:36.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 >> v1:172.21.15.31:6804/40243 conn(0x7fc3a8041890 legacy=0x7fc3a8043d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 >> v1:172.21.15.31:6816/39613 conn(0x7fc3a8038da0 legacy=0x7fc3a803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 msgr2=0x7fc3c809ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cf083700 1 --2- 172.21.15.31:0/3232346267 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3c81335d0 0x7fc3c809ff00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc3c805caf0 tx=0x7fc3bc015000).stop 2024-04-26T07:28:36.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cd620700 1 -- 172.21.15.31:0/3232346267 reap_dead start 2024-04-26T07:28:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 shutdown_connections 2024-04-26T07:28:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 >> 172.21.15.31:0/3232346267 conn(0x7fc3c8060ee0 msgr2=0x7fc3c8130850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 shutdown_connections 2024-04-26T07:28:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.878+0000 7fc3cf083700 1 -- 172.21.15.31:0/3232346267 wait complete. 2024-04-26T07:28:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.879+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 shutdown_connections 2024-04-26T07:28:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.879+0000 7fa3a353c700 1 -- 172.21.15.31:0/2819413953 wait complete. 2024-04-26T07:28:36.883 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-04-26T07:28:36.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:28:36.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.886+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 --> v1:172.21.15.31:6812/40244 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f371c006d80 con 0x7f371c0015f0 2024-04-26T07:28:36.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.887+0000 7f37417fa700 1 -- 172.21.15.31:0/3693141688 <== osd.2 v1:172.21.15.31:6812/40244 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1129848789) 0x7f371c006d80 con 0x7f371c0015f0 2024-04-26T07:28:36.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.887+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 >> v1:172.21.15.31:6812/40244 conn(0x7f371c0015f0 legacy=0x7f371c003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.887+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 >> v1:172.21.15.31:6816/39613 conn(0x7f3728038da0 legacy=0x7f372803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.887+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440934d0 msgr2=0x7f3744133790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:36.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.887+0000 7f3749b24700 1 --2- 172.21.15.31:0/3693141688 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f37440934d0 0x7f3744133790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f372c002f70 tx=0x7f372c006e40).stop 2024-04-26T07:28:36.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.887+0000 7f3743fff700 1 -- 172.21.15.31:0/3693141688 reap_dead start 2024-04-26T07:28:36.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.889+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 shutdown_connections 2024-04-26T07:28:36.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.889+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 >> 172.21.15.31:0/3693141688 conn(0x7f374405bfc0 msgr2=0x7f37441322b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:36.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.889+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 shutdown_connections 2024-04-26T07:28:36.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.889+0000 7f3749b24700 1 -- 172.21.15.31:0/3693141688 wait complete. 2024-04-26T07:28:36.890 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-04-26T07:28:36.891 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:28:36.892 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-04-26T07:28:36.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:28:36.901 INFO:teuthology.orchestra.run.smithi031.stdout:38654705670 2024-04-26T07:28:36.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:28:36.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.999+0000 7fbdd70e9700 1 Processor -- start 2024-04-26T07:28:37.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:36.999+0000 7fbdd70e9700 1 -- start start 2024-04-26T07:28:37.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.000+0000 7fbdd70e9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbdd006c7d0 0x7fbdd01360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.000+0000 7fbdd70e9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.000+0000 7fbdd70e9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00970a0 con 0x7fbdd005be60 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.000+0000 7fbdd70e9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd0133c10 con 0x7fbdd006c7d0 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.000+0000 7fbdd70e9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0136780 con 0x7fbdd0096320 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.000+0000 7fbdd5686700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbdd005be60 0x7fbdd0140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46646/0 (socket says 172.21.15.31:46646) 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.000+0000 7fbdd5686700 1 -- 172.21.15.31:0/4239034174 learned_addr learned my addr 172.21.15.31:0/4239034174 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.000+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcf7fe700 1 -- 172.21.15.31:0/4239034174 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927068086 0 0) 0x7fbdd00970a0 con 0x7fbdd005be60 2024-04-26T07:28:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcffff700 1 -- 172.21.15.31:0/4239034174 >> v2:172.21.15.31:3300/0 conn(0x7fbdd006c7d0 msgr2=0x7fbdd01360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcffff700 1 --2- 172.21.15.31:0/4239034174 >> v2:172.21.15.31:3300/0 conn(0x7fbdd006c7d0 0x7fbdd01360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcffff700 1 -- 172.21.15.31:0/4239034174 >> v1:172.21.15.31:6789/0 conn(0x7fbdd005be60 legacy=0x7fbdd0140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcffff700 1 -- 172.21.15.31:0/4239034174 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0136a40 con 0x7fbdd0096320 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcffff700 1 --2- 172.21.15.31:0/4239034174 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd005b970 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbdbc002f70 tx=0x7fbdbc006df0).ready entity=mon.2 client_cookie=399f0b538ac5bf0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcf7fe700 1 -- 172.21.15.31:0/4239034174 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdbc00d570 con 0x7fbdd0096320 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcf7fe700 1 -- 172.21.15.31:0/4239034174 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc000e90 con 0x7fbdd0096320 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.001+0000 7fbdcf7fe700 1 -- 172.21.15.31:0/4239034174 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdbc00d8c0 con 0x7fbdd0096320 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.002+0000 7fbdd70e9700 1 -- 172.21.15.31:0/4239034174 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 msgr2=0x7fbdd005b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.002+0000 7fbdd70e9700 1 --2- 172.21.15.31:0/4239034174 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd005b970 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbdbc002f70 tx=0x7fbdbc006df0).stop 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.002+0000 7fbdd70e9700 1 -- 172.21.15.31:0/4239034174 shutdown_connections 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.002+0000 7fbdd70e9700 1 --2- 172.21.15.31:0/4239034174 >> v2:172.21.15.31:3300/0 conn(0x7fbdd006c7d0 0x7fbdd01360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.002+0000 7fbdd70e9700 1 --2- 172.21.15.31:0/4239034174 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd005b970 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.002+0000 7fbdd70e9700 1 -- 172.21.15.31:0/4239034174 >> 172.21.15.31:0/4239034174 conn(0x7fbdd0061370 msgr2=0x7fbdd006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.002+0000 7fbdd70e9700 1 -- 172.21.15.31:0/4239034174 shutdown_connections 2024-04-26T07:28:37.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.002+0000 7fbdd70e9700 1 -- 172.21.15.31:0/4239034174 wait complete. 2024-04-26T07:28:37.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.003+0000 7fbdd70e9700 1 Processor -- start 2024-04-26T07:28:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.003+0000 7fbdd70e9700 1 -- start start 2024-04-26T07:28:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd70e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd005be60 0x7fbdd0066a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd70e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd006c7d0 0x7fbdd0132930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd70e9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd0132e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd70e9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0066260 con 0x7fbdd005be60 2024-04-26T07:28:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd70e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00a6d30 con 0x7fbdd006c7d0 2024-04-26T07:28:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd70e9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0064110 con 0x7fbdd0096320 2024-04-26T07:28:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd006c7d0 0x7fbdd0132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd006c7d0 0x7fbdd0132930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39502/0 (socket says 172.21.15.31:39502) 2024-04-26T07:28:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdcffff700 1 -- 172.21.15.31:0/3809126358 learned_addr learned my addr 172.21.15.31:0/3809126358 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd4e85700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd005be60 0x7fbdd0066a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd5686700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd0132e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd4e85700 1 -- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 msgr2=0x7fbdd0132e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd4e85700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd0132e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd4e85700 1 -- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd006c7d0 msgr2=0x7fbdd0132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd4e85700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd006c7d0 0x7fbdd0132930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd4e85700 1 -- 172.21.15.31:0/3809126358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc00b180 con 0x7fbdd005be60 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdcffff700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd006c7d0 0x7fbdd0132930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.004+0000 7fbdd4e85700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd005be60 0x7fbdd0066a60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fbdc4002f70 tx=0x7fbdc4006e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.005+0000 7fbdcdffb700 1 -- 172.21.15.31:0/3809126358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc4013460 con 0x7fbdd005be60 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.005+0000 7fbdcdffb700 1 -- 172.21.15.31:0/3809126358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40135c0 con 0x7fbdd005be60 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.005+0000 7fbdcdffb700 1 -- 172.21.15.31:0/3809126358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc4013920 con 0x7fbdd005be60 2024-04-26T07:28:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.005+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd00663d0 con 0x7fbdd005be60 2024-04-26T07:28:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.005+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd009dbe0 con 0x7fbdd005be60 2024-04-26T07:28:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.006+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0136500 con 0x7fbdd005be60 2024-04-26T07:28:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.007+0000 7fbdcdffb700 1 -- 172.21.15.31:0/3809126358 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbdc400f070 con 0x7fbdd005be60 2024-04-26T07:28:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.007+0000 7fbdcdffb700 1 -- 172.21.15.31:0/3809126358 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbdc404a060 con 0x7fbdd005be60 2024-04-26T07:28:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.010+0000 7fbdcdffb700 1 -- 172.21.15.31:0/3809126358 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbdc406b7c0 con 0x7fbdd005be60 2024-04-26T07:28:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.020+0000 7f2c5858d700 1 Processor -- start 2024-04-26T07:28:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.020+0000 7f2c5858d700 1 -- start start 2024-04-26T07:28:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c5858d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50066e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c5858d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c5005dfb0 0x7f2c5005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c5858d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c50066600 con 0x7f2c5005be60 2024-04-26T07:28:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c5858d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c500a4730 con 0x7f2c5005dfb0 2024-04-26T07:28:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c5858d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500a49d0 con 0x7f2c50067d70 2024-04-26T07:28:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56329700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56329700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50066e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39518/0 (socket says 172.21.15.31:39518) 2024-04-26T07:28:37.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56329700 1 -- 172.21.15.31:0/1268708244 learned_addr learned my addr 172.21.15.31:0/1268708244 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56b2a700 1 --1- 172.21.15.31:0/1268708244 >> v1:172.21.15.31:6789/0 conn(0x7f2c5005be60 0x7f2c501330a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46650/0 (socket says 172.21.15.31:46650) 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c55b28700 1 --2- 172.21.15.31:0/1268708244 >> v2:172.21.15.31:3300/0 conn(0x7f2c5005dfb0 0x7f2c5005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56329700 1 -- 172.21.15.31:0/1268708244 >> v2:172.21.15.31:3300/0 conn(0x7f2c5005dfb0 msgr2=0x7f2c5005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56329700 1 --2- 172.21.15.31:0/1268708244 >> v2:172.21.15.31:3300/0 conn(0x7f2c5005dfb0 0x7f2c5005b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56329700 1 -- 172.21.15.31:0/1268708244 >> v1:172.21.15.31:6789/0 conn(0x7f2c5005be60 legacy=0x7f2c501330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56329700 1 -- 172.21.15.31:0/1268708244 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c500a38c0 con 0x7f2c50067d70 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c55327700 1 -- 172.21.15.31:0/1268708244 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506587326 0 0) 0x7f2c50066600 con 0x7f2c5005be60 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.021+0000 7f2c56329700 1 --2- 172.21.15.31:0/1268708244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50066e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2c4c002f70 tx=0x7f2c4c006eb0).ready entity=mon.1 client_cookie=3ad81a1517d14a60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c55327700 1 -- 172.21.15.31:0/1268708244 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c4c00d570 con 0x7f2c50067d70 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c55327700 1 -- 172.21.15.31:0/1268708244 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c000e90 con 0x7f2c50067d70 2024-04-26T07:28:37.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c55327700 1 -- 172.21.15.31:0/1268708244 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c4c00d8c0 con 0x7f2c50067d70 2024-04-26T07:28:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c5858d700 1 -- 172.21.15.31:0/1268708244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 msgr2=0x7f2c50066e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c5858d700 1 --2- 172.21.15.31:0/1268708244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50066e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2c4c002f70 tx=0x7f2c4c006eb0).stop 2024-04-26T07:28:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c5858d700 1 -- 172.21.15.31:0/1268708244 shutdown_connections 2024-04-26T07:28:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c5858d700 1 --2- 172.21.15.31:0/1268708244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50066e70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c5858d700 1 --2- 172.21.15.31:0/1268708244 >> v2:172.21.15.31:3300/0 conn(0x7f2c5005dfb0 0x7f2c5005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c5858d700 1 -- 172.21.15.31:0/1268708244 >> 172.21.15.31:0/1268708244 conn(0x7f2c50060ee0 msgr2=0x7f2c500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c5858d700 1 -- 172.21.15.31:0/1268708244 shutdown_connections 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.022+0000 7f2c5858d700 1 -- 172.21.15.31:0/1268708244 wait complete. 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.024+0000 7f2c5858d700 1 Processor -- start 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.024+0000 7f2c5858d700 1 -- start start 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c5858d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c5005be60 0x7f2c5009ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c5858d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c5005dfb0 0x7f2c50148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c5858d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c5858d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50134c50 con 0x7f2c5005dfb0 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c5858d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50137190 con 0x7f2c50067d70 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c5858d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50133910 con 0x7f2c5005be60 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c55b28700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c5005dfb0 0x7f2c50148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c55b28700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c5005dfb0 0x7f2c50148c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36854/0 (socket says 172.21.15.31:36854) 2024-04-26T07:28:37.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c55b28700 1 -- 172.21.15.31:0/4177892725 learned_addr learned my addr 172.21.15.31:0/4177892725 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c56b2a700 1 --2- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c55b28700 1 -- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c5005be60 msgr2=0x7f2c5009ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c55b28700 1 --2- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c5005be60 0x7f2c5009ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c55b28700 1 -- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 msgr2=0x7f2c50149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c55b28700 1 --2- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.025+0000 7f2c55b28700 1 -- 172.21.15.31:0/4177892725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c00b1e0 con 0x7f2c5005dfb0 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.026+0000 7f2c55b28700 1 --2- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c5005dfb0 0x7f2c50148c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2c4000c000 tx=0x7f2c40006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.026+0000 7f2c3f7fe700 1 -- 172.21.15.31:0/4177892725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c40010590 con 0x7f2c5005dfb0 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.026+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5009f5d0 con 0x7f2c5005dfb0 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.026+0000 7f2c3f7fe700 1 -- 172.21.15.31:0/4177892725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400106f0 con 0x7f2c5005dfb0 2024-04-26T07:28:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.026+0000 7f2c3f7fe700 1 -- 172.21.15.31:0/4177892725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c40010a50 con 0x7f2c5005dfb0 2024-04-26T07:28:37.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.026+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c50149670 con 0x7f2c5005dfb0 2024-04-26T07:28:37.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.027+0000 7f2c3f7fe700 1 -- 172.21.15.31:0/4177892725 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2c40010bb0 con 0x7f2c5005dfb0 2024-04-26T07:28:37.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.027+0000 7f2c3f7fe700 1 -- 172.21.15.31:0/4177892725 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2c4004a9d0 con 0x7f2c5005dfb0 2024-04-26T07:28:37.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.028+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c500a3f20 con 0x7f2c5005dfb0 2024-04-26T07:28:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.031+0000 7f2c3f7fe700 1 -- 172.21.15.31:0/4177892725 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2c4002f680 con 0x7f2c5005dfb0 2024-04-26T07:28:37.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.062+0000 7f5780f1b700 1 Processor -- start 2024-04-26T07:28:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.062+0000 7f5780f1b700 1 -- start start 2024-04-26T07:28:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f5780f1b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c1360f0 0x7f577c096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f5780f1b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c05c080 0x7f577c141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f5780f1b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c0970a0 con 0x7f577c06c7d0 2024-04-26T07:28:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f5780f1b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c133c10 con 0x7f577c05c080 2024-04-26T07:28:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f5780f1b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f577c096810 con 0x7f577c1360f0 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f5779d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c1360f0 0x7f577c096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f5779d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c1360f0 0x7f577c096320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:40692/0 (socket says 172.21.15.31:40692) 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f5779d9b700 1 -- 172.21.15.31:0/281791791 learned_addr learned my addr 172.21.15.31:0/281791791 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.063+0000 7f577ad9d700 1 --2- 172.21.15.31:0/281791791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c05c080 0x7f577c141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.064+0000 7f5779d9b700 1 -- 172.21.15.31:0/281791791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c05c080 msgr2=0x7f577c141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.064+0000 7f5779d9b700 1 --2- 172.21.15.31:0/281791791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c05c080 0x7f577c141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.064+0000 7f5779d9b700 1 -- 172.21.15.31:0/281791791 >> v1:172.21.15.31:6789/0 conn(0x7f577c06c7d0 legacy=0x7f577c05b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.064+0000 7f5779d9b700 1 -- 172.21.15.31:0/281791791 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c1364d0 con 0x7f577c1360f0 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.064+0000 7f5779d9b700 1 --2- 172.21.15.31:0/281791791 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c1360f0 0x7f577c096320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f577c06d0b0 tx=0x7f5770006eb0).ready entity=mon.2 client_cookie=5fc447669f47c19b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.064+0000 7f577959a700 1 -- 172.21.15.31:0/281791791 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577000d570 con 0x7f577c1360f0 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.064+0000 7f577959a700 1 -- 172.21.15.31:0/281791791 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5770000e90 con 0x7f577c1360f0 2024-04-26T07:28:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.064+0000 7f577959a700 1 -- 172.21.15.31:0/281791791 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577000d900 con 0x7f577c1360f0 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.065+0000 7f5780f1b700 1 -- 172.21.15.31:0/281791791 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c1360f0 msgr2=0x7f577c096320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.065+0000 7f5780f1b700 1 --2- 172.21.15.31:0/281791791 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c1360f0 0x7f577c096320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f577c06d0b0 tx=0x7f5770006eb0).stop 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.065+0000 7f5780f1b700 1 -- 172.21.15.31:0/281791791 shutdown_connections 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.065+0000 7f5780f1b700 1 --2- 172.21.15.31:0/281791791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c05c080 0x7f577c141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.065+0000 7f5780f1b700 1 --2- 172.21.15.31:0/281791791 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c1360f0 0x7f577c096320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.065+0000 7f5780f1b700 1 -- 172.21.15.31:0/281791791 >> 172.21.15.31:0/281791791 conn(0x7f577c061370 msgr2=0x7f577c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.065+0000 7f5780f1b700 1 -- 172.21.15.31:0/281791791 shutdown_connections 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.065+0000 7f5780f1b700 1 -- 172.21.15.31:0/281791791 wait complete. 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.067+0000 7f5780f1b700 1 Processor -- start 2024-04-26T07:28:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.067+0000 7f5780f1b700 1 -- start start 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f5780f1b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c05c080 0x7f577c063560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f5780f1b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c06c7d0 0x7f577c064e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f5780f1b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c1360f0 0x7f577c149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f5780f1b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c0643f0 con 0x7f577c05c080 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f5780f1b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c064900 con 0x7f577c1360f0 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f5780f1b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f577c149b30 con 0x7f577c06c7d0 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c1360f0 0x7f577c149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c05c080 0x7f577c063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c1360f0 0x7f577c149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39552/0 (socket says 172.21.15.31:39552) 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 -- 172.21.15.31:0/3739269857 learned_addr learned my addr 172.21.15.31:0/3739269857 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f5779d9b700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c06c7d0 0x7f577c064e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 -- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c06c7d0 msgr2=0x7f577c064e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c06c7d0 0x7f577c064e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 -- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c05c080 msgr2=0x7f577c063560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c05c080 0x7f577c063560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 -- 172.21.15.31:0/3739269857 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577000b1e0 con 0x7f577c1360f0 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577a59c700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c05c080 0x7f577c063560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.068+0000 7f577ad9d700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c1360f0 0x7f577c149df0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f577c13a480 tx=0x7f57740091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.069+0000 7f576b7fe700 1 -- 172.21.15.31:0/3739269857 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577400c640 con 0x7f577c1360f0 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.069+0000 7f576b7fe700 1 -- 172.21.15.31:0/3739269857 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577400c7a0 con 0x7f577c1360f0 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.069+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c064620 con 0x7f577c1360f0 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.069+0000 7f576b7fe700 1 -- 172.21.15.31:0/3739269857 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577400cb00 con 0x7f577c1360f0 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.069+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c064040 con 0x7f577c1360f0 2024-04-26T07:28:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.070+0000 7f576b7fe700 1 -- 172.21.15.31:0/3739269857 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f577400cc60 con 0x7f577c1360f0 2024-04-26T07:28:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.070+0000 7f576b7fe700 1 -- 172.21.15.31:0/3739269857 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f577404aac0 con 0x7f577c1360f0 2024-04-26T07:28:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.070+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c062880 con 0x7f577c1360f0 2024-04-26T07:28:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.072+0000 7efd290f4700 1 Processor -- start 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.072+0000 7efd290f4700 1 -- start start 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd290f4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd2409bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd290f4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd24144df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd290f4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2413db60 con 0x7efd2413dfe0 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd290f4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2409c4d0 con 0x7efd2409bff0 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd290f4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd240a4910 con 0x7efd240a4510 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd22d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efd2413dfe0 0x7efd2413e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46668/0 (socket says 172.21.15.31:46668) 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd22d9d700 1 -- 172.21.15.31:0/877346965 learned_addr learned my addr 172.21.15.31:0/877346965 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd2259c700 1 --2- 172.21.15.31:0/877346965 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd2409bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd21d9b700 1 -- 172.21.15.31:0/877346965 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615850861 0 0) 0x7efd2413db60 con 0x7efd2413dfe0 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd21d9b700 1 -- 172.21.15.31:0/877346965 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd08003260 con 0x7efd2413dfe0 2024-04-26T07:28:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd2259c700 1 -- 172.21.15.31:0/877346965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 msgr2=0x7efd24144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd2259c700 1 --2- 172.21.15.31:0/877346965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd24144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd2259c700 1 -- 172.21.15.31:0/877346965 >> v1:172.21.15.31:6789/0 conn(0x7efd2413dfe0 legacy=0x7efd2413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd2259c700 1 -- 172.21.15.31:0/877346965 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240a3d30 con 0x7efd240a4510 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.073+0000 7efd2259c700 1 --2- 172.21.15.31:0/877346965 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd2409bb00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7efd18002f70 tx=0x7efd18006df0).ready entity=mon.2 client_cookie=a68acef92c0bf6ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd21d9b700 1 -- 172.21.15.31:0/877346965 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd1800d570 con 0x7efd240a4510 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd21d9b700 1 -- 172.21.15.31:0/877346965 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd18000e90 con 0x7efd240a4510 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd21d9b700 1 -- 172.21.15.31:0/877346965 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd1800d8c0 con 0x7efd240a4510 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd290f4700 1 -- 172.21.15.31:0/877346965 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 msgr2=0x7efd2409bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd290f4700 1 --2- 172.21.15.31:0/877346965 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd2409bb00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7efd18002f70 tx=0x7efd18006df0).stop 2024-04-26T07:28:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd290f4700 1 -- 172.21.15.31:0/877346965 shutdown_connections 2024-04-26T07:28:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd290f4700 1 --2- 172.21.15.31:0/877346965 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd24144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd290f4700 1 --2- 172.21.15.31:0/877346965 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd2409bb00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.074+0000 7efd290f4700 1 -- 172.21.15.31:0/877346965 >> 172.21.15.31:0/877346965 conn(0x7efd24060ee0 msgr2=0x7efd240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.075+0000 7efd290f4700 1 -- 172.21.15.31:0/877346965 shutdown_connections 2024-04-26T07:28:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.075+0000 7efd290f4700 1 -- 172.21.15.31:0/877346965 wait complete. 2024-04-26T07:28:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.075+0000 7efd290f4700 1 Processor -- start 2024-04-26T07:28:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd290f4700 1 -- start start 2024-04-26T07:28:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd290f4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd240a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd290f4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd24062110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd290f4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2413dfe0 0x7efd241330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd290f4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2413aa80 con 0x7efd2413dfe0 2024-04-26T07:28:37.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd290f4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2413a100 con 0x7efd2409bff0 2024-04-26T07:28:37.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd290f4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd2413a350 con 0x7efd240a4510 2024-04-26T07:28:37.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd22d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd240a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd22d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd240a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39566/0 (socket says 172.21.15.31:39566) 2024-04-26T07:28:37.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd2259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd24062110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd22d9d700 1 -- 172.21.15.31:0/2665210051 learned_addr learned my addr 172.21.15.31:0/2665210051 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:37.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.076+0000 7efd2359e700 1 --2- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2413dfe0 0x7efd241330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:37.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7f576b7fe700 1 -- 172.21.15.31:0/3739269857 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f577c062880 con 0x7f577c1360f0 2024-04-26T07:28:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd22d9d700 1 -- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 msgr2=0x7efd24062110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd22d9d700 1 --2- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd24062110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd22d9d700 1 -- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2413dfe0 msgr2=0x7efd241330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd22d9d700 1 --2- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2413dfe0 0x7efd241330a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd22d9d700 1 -- 172.21.15.31:0/2665210051 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1800b180 con 0x7efd2409bff0 2024-04-26T07:28:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd22d9d700 1 --2- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd240a1880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efd24062d80 tx=0x7efd14007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd13fff700 1 -- 172.21.15.31:0/2665210051 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd140070d0 con 0x7efd2409bff0 2024-04-26T07:28:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd240a1d70 con 0x7efd2409bff0 2024-04-26T07:28:37.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2413adb0 con 0x7efd2409bff0 2024-04-26T07:28:37.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd13fff700 1 -- 172.21.15.31:0/2665210051 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14007230 con 0x7efd2409bff0 2024-04-26T07:28:37.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.077+0000 7efd13fff700 1 -- 172.21.15.31:0/2665210051 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd14005610 con 0x7efd2409bff0 2024-04-26T07:28:37.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.078+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd04003410 con 0x7efd2409bff0 2024-04-26T07:28:37.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.079+0000 7efd13fff700 1 -- 172.21.15.31:0/2665210051 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7efd1401a060 con 0x7efd2409bff0 2024-04-26T07:28:37.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.079+0000 7efd13fff700 1 -- 172.21.15.31:0/2665210051 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efd14049fd0 con 0x7efd2409bff0 2024-04-26T07:28:37.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.085+0000 7efd13fff700 1 -- 172.21.15.31:0/2665210051 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7efd1402ee40 con 0x7efd2409bff0 2024-04-26T07:28:37.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.139+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbdd006bbc0 con 0x7fbdd005be60 2024-04-26T07:28:37.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.139+0000 7fbdcdffb700 1 -- 172.21.15.31:0/3809126358 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbdc402ee50 con 0x7fbdd005be60 2024-04-26T07:28:37.139 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-04-26T07:28:37.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.141+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 >> v1:172.21.15.31:6816/39613 conn(0x7fbdb0038ec0 legacy=0x7fbdb003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.141+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd005be60 msgr2=0x7fbdd0066a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.141+0000 7fbdd70e9700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd005be60 0x7fbdd0066a60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fbdc4002f70 tx=0x7fbdc4006e00).stop 2024-04-26T07:28:37.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.142+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 shutdown_connections 2024-04-26T07:28:37.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.142+0000 7fbdd70e9700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdd0096320 0x7fbdd0132e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.142+0000 7fbdd70e9700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd005be60 0x7fbdd0066a60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.142+0000 7fbdd70e9700 1 --2- 172.21.15.31:0/3809126358 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdd006c7d0 0x7fbdd0132930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.142+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 >> 172.21.15.31:0/3809126358 conn(0x7fbdd0061370 msgr2=0x7fbdd01345a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:37.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.142+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 shutdown_connections 2024-04-26T07:28:37.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.142+0000 7fbdd70e9700 1 -- 172.21.15.31:0/3809126358 wait complete. 2024-04-26T07:28:37.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-04-26T07:28:37.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.175+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c5006bbc0 con 0x7f2c5005dfb0 2024-04-26T07:28:37.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.175+0000 7f2c3f7fe700 1 -- 172.21.15.31:0/4177892725 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c40032e50 con 0x7f2c5005dfb0 2024-04-26T07:28:37.175 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-04-26T07:28:37.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 >> v1:172.21.15.31:6816/39613 conn(0x7f2c30038da0 legacy=0x7f2c3003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c5005dfb0 msgr2=0x7f2c50148c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 --2- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c5005dfb0 0x7f2c50148c90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2c4000c000 tx=0x7f2c40006df0).stop 2024-04-26T07:28:37.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 shutdown_connections 2024-04-26T07:28:37.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 --2- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2c5005be60 0x7f2c5009ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:37.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 --2- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c50067d70 0x7f2c50149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 --2- 172.21.15.31:0/4177892725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c5005dfb0 0x7f2c50148c90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 >> 172.21.15.31:0/4177892725 conn(0x7f2c50060ee0 msgr2=0x7f2c500a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:37.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 shutdown_connections 2024-04-26T07:28:37.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.177+0000 7f2c5858d700 1 -- 172.21.15.31:0/4177892725 wait complete. 2024-04-26T07:28:37.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-04-26T07:28:37.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.204+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f577c062880 con 0x7f577c1360f0 2024-04-26T07:28:37.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.205+0000 7f576b7fe700 1 -- 172.21.15.31:0/3739269857 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f577c062880 con 0x7f577c1360f0 2024-04-26T07:28:37.206 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-04-26T07:28:37.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd040036c0 con 0x7efd2409bff0 2024-04-26T07:28:37.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7efd13fff700 1 -- 172.21.15.31:0/2665210051 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd140323e0 con 0x7efd2409bff0 2024-04-26T07:28:37.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 >> v1:172.21.15.31:6816/39613 conn(0x7f5758038da0 legacy=0x7f575803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c1360f0 msgr2=0x7f577c149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c1360f0 0x7f577c149df0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f577c13a480 tx=0x7f57740091d0).stop 2024-04-26T07:28:37.207 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-04-26T07:28:37.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 shutdown_connections 2024-04-26T07:28:37.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f577c1360f0 0x7f577c149df0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f577c05c080 0x7f577c063560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 --2- 172.21.15.31:0/3739269857 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f577c06c7d0 0x7f577c064e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 >> 172.21.15.31:0/3739269857 conn(0x7f577c061370 msgr2=0x7f577c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:37.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 shutdown_connections 2024-04-26T07:28:37.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.206+0000 7f5780f1b700 1 -- 172.21.15.31:0/3739269857 wait complete. 2024-04-26T07:28:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 >> v1:172.21.15.31:6816/39613 conn(0x7efd00038da0 legacy=0x7efd0003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 msgr2=0x7efd240a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 --2- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd240a1880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efd24062d80 tx=0x7efd14007ad0).stop 2024-04-26T07:28:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 shutdown_connections 2024-04-26T07:28:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 --2- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd2413dfe0 0x7efd241330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 --2- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd2409bff0 0x7efd240a1880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 --2- 172.21.15.31:0/2665210051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efd240a4510 0x7efd24062110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 >> 172.21.15.31:0/2665210051 conn(0x7efd24060ee0 msgr2=0x7efd2405c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:37.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 shutdown_connections 2024-04-26T07:28:37.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:37.208+0000 7efd290f4700 1 -- 172.21.15.31:0/2665210051 wait complete. 2024-04-26T07:28:37.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2024-04-26T07:28:37.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-04-26T07:28:38.159 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:28:38.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:28:38.219 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:28:38.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:28:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.291+0000 7f6a1f487700 1 Processor -- start 2024-04-26T07:28:38.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.291+0000 7f6a1f487700 1 -- start start 2024-04-26T07:28:38.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1f487700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a18137a50 0x7f6a18137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1f487700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a1809ff30 0x7f6a180a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1f487700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6a180a3740 0x7f6a1805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1f487700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180a4e20 con 0x7f6a180a3740 2024-04-26T07:28:38.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1f487700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18137620 con 0x7f6a1809ff30 2024-04-26T07:28:38.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1f487700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18138320 con 0x7f6a18137a50 2024-04-26T07:28:38.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1d223700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a18137a50 0x7f6a18137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1d223700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a18137a50 0x7f6a18137e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34646/0 (socket says 172.21.15.31:34646) 2024-04-26T07:28:38.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.292+0000 7f6a1d223700 1 -- 172.21.15.31:0/80775160 learned_addr learned my addr 172.21.15.31:0/80775160 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:38.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a1da24700 1 --2- 172.21.15.31:0/80775160 >> v2:172.21.15.31:3300/0 conn(0x7f6a180a3740 0x7f6a1805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a1ca22700 1 --2- 172.21.15.31:0/80775160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a1809ff30 0x7f6a180a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a1d223700 1 -- 172.21.15.31:0/80775160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a1809ff30 msgr2=0x7f6a180a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:38.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a1d223700 1 --2- 172.21.15.31:0/80775160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a1809ff30 0x7f6a180a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a1d223700 1 -- 172.21.15.31:0/80775160 >> v2:172.21.15.31:3300/0 conn(0x7f6a180a3740 msgr2=0x7f6a1805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a1d223700 1 --2- 172.21.15.31:0/80775160 >> v2:172.21.15.31:3300/0 conn(0x7f6a180a3740 0x7f6a1805b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a1d223700 1 -- 172.21.15.31:0/80775160 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180a46a0 con 0x7f6a18137a50 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a1d223700 1 --2- 172.21.15.31:0/80775160 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a18137a50 0x7f6a18137e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6a180a4c60 tx=0x7f6a14006eb0).ready entity=mon.2 client_cookie=31a3c1b9a578a256 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a07fff700 1 -- 172.21.15.31:0/80775160 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1400d570 con 0x7f6a18137a50 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a07fff700 1 -- 172.21.15.31:0/80775160 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14000e90 con 0x7f6a18137a50 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.293+0000 7f6a07fff700 1 -- 172.21.15.31:0/80775160 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1400d900 con 0x7f6a18137a50 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 -- 172.21.15.31:0/80775160 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a18137a50 msgr2=0x7f6a18137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 --2- 172.21.15.31:0/80775160 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a18137a50 0x7f6a18137e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6a180a4c60 tx=0x7f6a14006eb0).stop 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 -- 172.21.15.31:0/80775160 shutdown_connections 2024-04-26T07:28:38.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 --2- 172.21.15.31:0/80775160 >> v2:172.21.15.31:3300/0 conn(0x7f6a180a3740 0x7f6a1805b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 --2- 172.21.15.31:0/80775160 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a18137a50 0x7f6a18137e30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 --2- 172.21.15.31:0/80775160 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a1809ff30 0x7f6a180a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 -- 172.21.15.31:0/80775160 >> 172.21.15.31:0/80775160 conn(0x7f6a18060ee0 msgr2=0x7f6a180a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:38.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 -- 172.21.15.31:0/80775160 shutdown_connections 2024-04-26T07:28:38.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.294+0000 7f6a1f487700 1 -- 172.21.15.31:0/80775160 wait complete. 2024-04-26T07:28:38.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.296+0000 7f6a1f487700 1 Processor -- start 2024-04-26T07:28:38.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.296+0000 7f6a1f487700 1 -- start start 2024-04-26T07:28:38.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1f487700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a1809ff30 0x7f6a1813c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1f487700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a180a3740 0x7f6a18148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1f487700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a18137a50 0x7f6a181492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1f487700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18139740 con 0x7f6a180a3740 2024-04-26T07:28:38.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1f487700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181399e0 con 0x7f6a18137a50 2024-04-26T07:28:38.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1f487700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1813b3a0 con 0x7f6a1809ff30 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1ca22700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a180a3740 0x7f6a18148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1ca22700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a180a3740 0x7f6a18148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42064/0 (socket says 172.21.15.31:42064) 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1ca22700 1 -- 172.21.15.31:0/2976379346 learned_addr learned my addr 172.21.15.31:0/2976379346 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1d223700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a1809ff30 0x7f6a1813c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1da24700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a18137a50 0x7f6a181492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1ca22700 1 -- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a1809ff30 msgr2=0x7f6a1813c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1ca22700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a1809ff30 0x7f6a1813c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1ca22700 1 -- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a18137a50 msgr2=0x7f6a181492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.297+0000 7f6a1ca22700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a18137a50 0x7f6a181492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.298+0000 7f6a1ca22700 1 -- 172.21.15.31:0/2976379346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1400b1e0 con 0x7f6a180a3740 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.298+0000 7f6a1d223700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a1809ff30 0x7f6a1813c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:38.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.298+0000 7f6a1ca22700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a180a3740 0x7f6a18148e00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6a0800a000 tx=0x7f6a08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:38.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.298+0000 7f6a067fc700 1 -- 172.21.15.31:0/2976379346 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a08011780 con 0x7f6a180a3740 2024-04-26T07:28:38.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.298+0000 7f6a067fc700 1 -- 172.21.15.31:0/2976379346 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080118e0 con 0x7f6a180a3740 2024-04-26T07:28:38.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.298+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a18062ac0 con 0x7f6a180a3740 2024-04-26T07:28:38.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.298+0000 7f6a067fc700 1 -- 172.21.15.31:0/2976379346 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a08011c40 con 0x7f6a180a3740 2024-04-26T07:28:38.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.298+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a18062600 con 0x7f6a180a3740 2024-04-26T07:28:38.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.299+0000 7f6a067fc700 1 -- 172.21.15.31:0/2976379346 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6a0801c460 con 0x7f6a180a3740 2024-04-26T07:28:38.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.299+0000 7f6a067fc700 1 -- 172.21.15.31:0/2976379346 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6a0804abe0 con 0x7f6a180a3740 2024-04-26T07:28:38.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.300+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a180a0350 con 0x7f6a180a3740 2024-04-26T07:28:38.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.306+0000 7f6a067fc700 1 -- 172.21.15.31:0/2976379346 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6a08033510 con 0x7f6a180a3740 2024-04-26T07:28:38.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.340+0000 7f1b361e2700 1 Processor -- start 2024-04-26T07:28:38.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.340+0000 7f1b361e2700 1 -- start start 2024-04-26T07:28:38.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b361e2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b3006c990 0x7f1b300a8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b361e2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b300a8880 0x7f1b3013e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b361e2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3013db90 con 0x7f1b3013e700 2024-04-26T07:28:38.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b361e2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b300a8d60 con 0x7f1b3006c990 2024-04-26T07:28:38.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b361e2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300a5b30 con 0x7f1b300a8880 2024-04-26T07:28:38.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b2effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b300a8880 0x7f1b3013e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b2ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1b3013e700 0x7f1b3005b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60918/0 (socket says 172.21.15.31:60918) 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b2f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b3006c990 0x7f1b300a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.341+0000 7f1b2ffff700 1 -- 172.21.15.31:0/161680027 learned_addr learned my addr 172.21.15.31:0/161680027 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.342+0000 7f1b2f7fe700 1 -- 172.21.15.31:0/161680027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b300a8880 msgr2=0x7f1b3013e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.342+0000 7f1b2f7fe700 1 --2- 172.21.15.31:0/161680027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b300a8880 0x7f1b3013e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.342+0000 7f1b2f7fe700 1 -- 172.21.15.31:0/161680027 >> v1:172.21.15.31:6789/0 conn(0x7f1b3013e700 legacy=0x7f1b3005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.342+0000 7f1b2f7fe700 1 -- 172.21.15.31:0/161680027 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3006cd70 con 0x7f1b3006c990 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.342+0000 7f1b2f7fe700 1 --2- 172.21.15.31:0/161680027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3006c990 0x7f1b300a8390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f1b28001490 tx=0x7f1b20006df0).ready entity=mon.0 client_cookie=c20c6a18f1e48c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.342+0000 7f1b2e7fc700 1 -- 172.21.15.31:0/161680027 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b2000d4a0 con 0x7f1b3006c990 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.342+0000 7f1b2e7fc700 1 -- 172.21.15.31:0/161680027 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20000e90 con 0x7f1b3006c990 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.342+0000 7f1b2e7fc700 1 -- 172.21.15.31:0/161680027 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b2000d7f0 con 0x7f1b3006c990 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.343+0000 7f1b361e2700 1 -- 172.21.15.31:0/161680027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3006c990 msgr2=0x7f1b300a8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.343+0000 7f1b361e2700 1 --2- 172.21.15.31:0/161680027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3006c990 0x7f1b300a8390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f1b28001490 tx=0x7f1b20006df0).stop 2024-04-26T07:28:38.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.343+0000 7f1b361e2700 1 -- 172.21.15.31:0/161680027 shutdown_connections 2024-04-26T07:28:38.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.343+0000 7f1b361e2700 1 --2- 172.21.15.31:0/161680027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3006c990 0x7f1b300a8390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.343+0000 7f1b361e2700 1 --2- 172.21.15.31:0/161680027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b300a8880 0x7f1b3013e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.343+0000 7f1b361e2700 1 -- 172.21.15.31:0/161680027 >> 172.21.15.31:0/161680027 conn(0x7f1b30061370 msgr2=0x7f1b3006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:38.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.343+0000 7f1b361e2700 1 -- 172.21.15.31:0/161680027 shutdown_connections 2024-04-26T07:28:38.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.343+0000 7f1b361e2700 1 -- 172.21.15.31:0/161680027 wait complete. 2024-04-26T07:28:38.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.344+0000 7f1b361e2700 1 Processor -- start 2024-04-26T07:28:38.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.344+0000 7f1b361e2700 1 -- start start 2024-04-26T07:28:38.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b361e2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b3006c990 0x7f1b30092e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b361e2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b300a8880 0x7f1b30064780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b361e2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b3013e700 0x7f1b30064c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b361e2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30093330 con 0x7f1b300a8880 2024-04-26T07:28:38.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b361e2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30099000 con 0x7f1b3013e700 2024-04-26T07:28:38.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b361e2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30092940 con 0x7f1b3006c990 2024-04-26T07:28:38.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b3006c990 0x7f1b30092e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b3006c990 0x7f1b30092e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34674/0 (socket says 172.21.15.31:34674) 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2f7fe700 1 -- 172.21.15.31:0/2299885163 learned_addr learned my addr 172.21.15.31:0/2299885163 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2effd700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b300a8880 0x7f1b30064780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2ffff700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b3013e700 0x7f1b30064c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2ffff700 1 -- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b3006c990 msgr2=0x7f1b30092e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2ffff700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b3006c990 0x7f1b30092e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2ffff700 1 -- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b300a8880 msgr2=0x7f1b30064780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2ffff700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b300a8880 0x7f1b30064780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.345+0000 7f1b2ffff700 1 -- 172.21.15.31:0/2299885163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2000b180 con 0x7f1b3013e700 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.346+0000 7f1b2ffff700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b3013e700 0x7f1b30064c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1b28001360 tx=0x7f1b28007e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.346+0000 7f1b2cff9700 1 -- 172.21.15.31:0/2299885163 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b28005ba0 con 0x7f1b3013e700 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.346+0000 7f1b2cff9700 1 -- 172.21.15.31:0/2299885163 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28005d00 con 0x7f1b3013e700 2024-04-26T07:28:38.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.346+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b30063fb0 con 0x7f1b3013e700 2024-04-26T07:28:38.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.346+0000 7f1b2cff9700 1 -- 172.21.15.31:0/2299885163 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b280072c0 con 0x7f1b3013e700 2024-04-26T07:28:38.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.346+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b30067150 con 0x7f1b3013e700 2024-04-26T07:28:38.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.347+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b30066ac0 con 0x7f1b3013e700 2024-04-26T07:28:38.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.347+0000 7f1b2cff9700 1 -- 172.21.15.31:0/2299885163 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1b28010070 con 0x7f1b3013e700 2024-04-26T07:28:38.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.348+0000 7f1b2cff9700 1 -- 172.21.15.31:0/2299885163 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1b2804a2b0 con 0x7f1b3013e700 2024-04-26T07:28:38.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.351+0000 7f1b2cff9700 1 -- 172.21.15.31:0/2299885163 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1b2802f1b0 con 0x7f1b3013e700 2024-04-26T07:28:38.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.382+0000 7f7b50b83700 1 Processor -- start 2024-04-26T07:28:38.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.382+0000 7f7b50b83700 1 -- start start 2024-04-26T07:28:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.382+0000 7f7b50b83700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b4c0a22a0 0x7f7b4c09c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b50b83700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c13e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b50b83700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c09d150 con 0x7f7b4c0a2680 2024-04-26T07:28:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b50b83700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c09dd80 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b50b83700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c09ce90 con 0x7f7b4c0a3880 2024-04-26T07:28:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b4c0a22a0 0x7f7b4c09c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b49d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7b4c0a2680 0x7f7b4c0a3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60930/0 (socket says 172.21.15.31:60930) 2024-04-26T07:28:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b49d9b700 1 -- 172.21.15.31:0/149030823 learned_addr learned my addr 172.21.15.31:0/149030823 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4ad9d700 1 --2- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c13e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4959a700 1 -- 172.21.15.31:0/149030823 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947961062 0 0) 0x7f7b4c09d150 con 0x7f7b4c0a2680 2024-04-26T07:28:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4a59c700 1 -- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 msgr2=0x7f7b4c13e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4a59c700 1 --2- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c13e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4a59c700 1 -- 172.21.15.31:0/149030823 >> v1:172.21.15.31:6789/0 conn(0x7f7b4c0a2680 legacy=0x7f7b4c0a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4a59c700 1 -- 172.21.15.31:0/149030823 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c09e2d0 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4ad9d700 1 --2- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c13e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T07:28:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.383+0000 7f7b4a59c700 1 --2- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a22a0 0x7f7b4c09c7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7b3c002f70 tx=0x7f7b3c006df0).ready entity=mon.0 client_cookie=ba30b6c7bf9ff9fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b4959a700 1 -- 172.21.15.31:0/149030823 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c00d570 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b4959a700 1 -- 172.21.15.31:0/149030823 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c000e90 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b4959a700 1 -- 172.21.15.31:0/149030823 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c00d8c0 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b50b83700 1 -- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a22a0 msgr2=0x7f7b4c09c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b50b83700 1 --2- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a22a0 0x7f7b4c09c7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7b3c002f70 tx=0x7f7b3c006df0).stop 2024-04-26T07:28:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b50b83700 1 -- 172.21.15.31:0/149030823 shutdown_connections 2024-04-26T07:28:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b50b83700 1 --2- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c13e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b50b83700 1 --2- 172.21.15.31:0/149030823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a22a0 0x7f7b4c09c7d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b50b83700 1 -- 172.21.15.31:0/149030823 >> 172.21.15.31:0/149030823 conn(0x7f7b4c060ee0 msgr2=0x7f7b4c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b50b83700 1 -- 172.21.15.31:0/149030823 shutdown_connections 2024-04-26T07:28:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.384+0000 7f7b50b83700 1 -- 172.21.15.31:0/149030823 wait complete. 2024-04-26T07:28:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.386+0000 7f7b50b83700 1 Processor -- start 2024-04-26T07:28:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.386+0000 7f7b50b83700 1 -- start start 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b50b83700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b4c0a22a0 0x7f7b4c065a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b50b83700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a2680 0x7f7b4c1305a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b50b83700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b50b83700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c131b70 con 0x7f7b4c0a2680 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b50b83700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c12feb0 con 0x7f7b4c0a3880 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b50b83700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c130d40 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b4c0a22a0 0x7f7b4c065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b4c0a22a0 0x7f7b4c065a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34676/0 (socket says 172.21.15.31:34676) 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 -- 172.21.15.31:0/1017591039 learned_addr learned my addr 172.21.15.31:0/1017591039 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b49d9b700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a2680 0x7f7b4c1305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4ad9d700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 -- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 msgr2=0x7f7b4c066770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c066770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 -- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a2680 msgr2=0x7f7b4c1305a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a2680 0x7f7b4c1305a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 -- 172.21.15.31:0/1017591039 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c00b180 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.387+0000 7f7b4a59c700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b4c0a22a0 0x7f7b4c065a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7b3c002f70 tx=0x7f7b3c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.388+0000 7f7b3b7fe700 1 -- 172.21.15.31:0/1017591039 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c011860 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.388+0000 7f7b3b7fe700 1 -- 172.21.15.31:0/1017591039 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0119c0 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.388+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c130fe0 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.388+0000 7f7b3b7fe700 1 -- 172.21.15.31:0/1017591039 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c011d20 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.388+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c066420 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.389+0000 7f7b3b7fe700 1 -- 172.21.15.31:0/1017591039 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7b3c025030 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.389+0000 7f7b3b7fe700 1 -- 172.21.15.31:0/1017591039 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7b3c04bb80 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.389+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c06bbc0 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.395+0000 7f7b3b7fe700 1 -- 172.21.15.31:0/1017591039 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7b3c028b30 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.397+0000 7f507c97a700 1 Processor -- start 2024-04-26T07:28:38.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.397+0000 7f507c97a700 1 -- start start 2024-04-26T07:28:38.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.398+0000 7f507c97a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f507805dfb0 0x7f50781330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.398+0000 7f507c97a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078133590 0x7f5078133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f507c97a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5078133f10 con 0x7f5078067d70 2024-04-26T07:28:38.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f507c97a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5078067580 con 0x7f5078133590 2024-04-26T07:28:38.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f507c97a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5078066600 con 0x7f507805dfb0 2024-04-26T07:28:38.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f507659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5078067d70 0x7f5078066e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60946/0 (socket says 172.21.15.31:60946) 2024-04-26T07:28:38.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f507659c700 1 -- 172.21.15.31:0/3209921466 learned_addr learned my addr 172.21.15.31:0/3209921466 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:38.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f5076d9d700 1 --2- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078133590 0x7f5078133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f5075d9b700 1 --2- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f507805dfb0 0x7f50781330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f5075d9b700 1 -- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078133590 msgr2=0x7f5078133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f5075d9b700 1 --2- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078133590 0x7f5078133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f5075d9b700 1 -- 172.21.15.31:0/3209921466 >> v1:172.21.15.31:6789/0 conn(0x7f5078067d70 legacy=0x7f5078066e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f5075d9b700 1 -- 172.21.15.31:0/3209921466 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50780a4730 con 0x7f507805dfb0 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.399+0000 7f5075d9b700 1 --2- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f507805dfb0 0x7f50781330a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f506c002f70 tx=0x7f506c006df0).ready entity=mon.2 client_cookie=2e89590bbc4552db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.400+0000 7f507559a700 1 -- 172.21.15.31:0/3209921466 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f506c00d570 con 0x7f507805dfb0 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.400+0000 7f507559a700 1 -- 172.21.15.31:0/3209921466 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c000e90 con 0x7f507805dfb0 2024-04-26T07:28:38.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.400+0000 7f507559a700 1 -- 172.21.15.31:0/3209921466 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f506c00d8c0 con 0x7f507805dfb0 2024-04-26T07:28:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.401+0000 7f507c97a700 1 -- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f507805dfb0 msgr2=0x7f50781330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.401+0000 7f507c97a700 1 --2- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f507805dfb0 0x7f50781330a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f506c002f70 tx=0x7f506c006df0).stop 2024-04-26T07:28:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.401+0000 7f507c97a700 1 -- 172.21.15.31:0/3209921466 shutdown_connections 2024-04-26T07:28:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.401+0000 7f507c97a700 1 --2- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078133590 0x7f5078133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.401+0000 7f507c97a700 1 --2- 172.21.15.31:0/3209921466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f507805dfb0 0x7f50781330a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.401+0000 7f507c97a700 1 -- 172.21.15.31:0/3209921466 >> 172.21.15.31:0/3209921466 conn(0x7f5078060ee0 msgr2=0x7f50780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.401+0000 7f507c97a700 1 -- 172.21.15.31:0/3209921466 shutdown_connections 2024-04-26T07:28:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.401+0000 7f507c97a700 1 -- 172.21.15.31:0/3209921466 wait complete. 2024-04-26T07:28:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.402+0000 7f507c97a700 1 Processor -- start 2024-04-26T07:28:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.402+0000 7f507c97a700 1 -- start start 2024-04-26T07:28:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507c97a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507805dfb0 0x7f5078136390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507c97a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078067d70 0x7f507809ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507c97a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5078133590 0x7f5078145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507c97a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5078136ea0 con 0x7f507805dfb0 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507c97a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5078145c30 con 0x7f5078067d70 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507c97a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5078143590 con 0x7f5078133590 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507805dfb0 0x7f5078136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507805dfb0 0x7f5078136390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42120/0 (socket says 172.21.15.31:42120) 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.403+0000 7f507659c700 1 -- 172.21.15.31:0/2156184101 learned_addr learned my addr 172.21.15.31:0/2156184101 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f5076d9d700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5078133590 0x7f5078145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f5075d9b700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078067d70 0x7f507809ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f507659c700 1 -- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5078133590 msgr2=0x7f5078145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f507659c700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5078133590 0x7f5078145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f507659c700 1 -- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078067d70 msgr2=0x7f507809ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f507659c700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078067d70 0x7f507809ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f507659c700 1 -- 172.21.15.31:0/2156184101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c00b180 con 0x7f507805dfb0 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f507659c700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507805dfb0 0x7f5078136390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f507805cb50 tx=0x7f5068007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f50677fe700 1 -- 172.21.15.31:0/2156184101 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50680070d0 con 0x7f507805dfb0 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f50677fe700 1 -- 172.21.15.31:0/2156184101 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068007230 con 0x7f507805dfb0 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.404+0000 7f50677fe700 1 -- 172.21.15.31:0/2156184101 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5068005610 con 0x7f507805dfb0 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.405+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5078145920 con 0x7f507805dfb0 2024-04-26T07:28:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.405+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50780a0430 con 0x7f507805dfb0 2024-04-26T07:28:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.406+0000 7f50677fe700 1 -- 172.21.15.31:0/2156184101 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5068010070 con 0x7f507805dfb0 2024-04-26T07:28:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.406+0000 7f50677fe700 1 -- 172.21.15.31:0/2156184101 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5068049c30 con 0x7f507805dfb0 2024-04-26T07:28:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.407+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5078133f10 con 0x7f507805dfb0 2024-04-26T07:28:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.410+0000 7f50677fe700 1 -- 172.21.15.31:0/2156184101 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5078133f10 con 0x7f507805dfb0 2024-04-26T07:28:38.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.517+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b300920d0 con 0x7f1b3013e700 2024-04-26T07:28:38.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.518+0000 7f1b2cff9700 1 -- 172.21.15.31:0/2299885163 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b28022020 con 0x7f1b3013e700 2024-04-26T07:28:38.518 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-04-26T07:28:38.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 >> v1:172.21.15.31:6816/39613 conn(0x7f1b10038e60 legacy=0x7f1b1003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b3013e700 msgr2=0x7f1b30064c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b3013e700 0x7f1b30064c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1b28001360 tx=0x7f1b28007e90).stop 2024-04-26T07:28:38.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 shutdown_connections 2024-04-26T07:28:38.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1b3006c990 0x7f1b30092e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b3013e700 0x7f1b30064c70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 --2- 172.21.15.31:0/2299885163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b300a8880 0x7f1b30064780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 >> 172.21.15.31:0/2299885163 conn(0x7f1b30061370 msgr2=0x7f1b3005c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:38.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 shutdown_connections 2024-04-26T07:28:38.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.519+0000 7f1b361e2700 1 -- 172.21.15.31:0/2299885163 wait complete. 2024-04-26T07:28:38.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.528+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a1806bbc0 con 0x7f6a180a3740 2024-04-26T07:28:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.528+0000 7f6a067fc700 1 -- 172.21.15.31:0/2976379346 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a0802b090 con 0x7f6a180a3740 2024-04-26T07:28:38.528 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-04-26T07:28:38.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 >> v1:172.21.15.31:6816/39613 conn(0x7f69f8038da0 legacy=0x7f69f803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a180a3740 msgr2=0x7f6a18148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a180a3740 0x7f6a18148e00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6a0800a000 tx=0x7f6a08008040).stop 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 shutdown_connections 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6a1809ff30 0x7f6a1813c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a18137a50 0x7f6a181492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 --2- 172.21.15.31:0/2976379346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a180a3740 0x7f6a18148e00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 >> 172.21.15.31:0/2976379346 conn(0x7f6a18060ee0 msgr2=0x7f6a1805c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 shutdown_connections 2024-04-26T07:28:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.530+0000 7f6a1f487700 1 -- 172.21.15.31:0/2976379346 wait complete. 2024-04-26T07:28:38.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-04-26T07:28:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.545+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7b4c0a4f90 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.546+0000 7f7b3b7fe700 1 -- 172.21.15.31:0/1017591039 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b3c0206d0 con 0x7f7b4c0a22a0 2024-04-26T07:28:38.547 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-04-26T07:28:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 >> v1:172.21.15.31:6816/39613 conn(0x7f7b28038ef0 legacy=0x7f7b2803b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b4c0a22a0 msgr2=0x7f7b4c065a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b4c0a22a0 0x7f7b4c065a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7b3c002f70 tx=0x7f7b3c015000).stop 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 shutdown_connections 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b4c0a22a0 0x7f7b4c065a70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b4c0a3880 0x7f7b4c066770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 --2- 172.21.15.31:0/1017591039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b4c0a2680 0x7f7b4c1305a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 >> 172.21.15.31:0/1017591039 conn(0x7f7b4c060ee0 msgr2=0x7f7b4c05c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 shutdown_connections 2024-04-26T07:28:38.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.548+0000 7f7b50b83700 1 -- 172.21.15.31:0/1017591039 wait complete. 2024-04-26T07:28:38.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2024-04-26T07:28:38.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.599+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5078133f10 con 0x7f507805dfb0 2024-04-26T07:28:38.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.599+0000 7f50677fe700 1 -- 172.21.15.31:0/2156184101 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5078133f10 con 0x7f507805dfb0 2024-04-26T07:28:38.599 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 >> v1:172.21.15.31:6816/39613 conn(0x7f5054038e30 legacy=0x7f505403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507805dfb0 msgr2=0x7f5078136390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507805dfb0 0x7f5078136390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f507805cb50 tx=0x7f5068007c40).stop 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 shutdown_connections 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5078133590 0x7f5078145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f507805dfb0 0x7f5078136390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 --2- 172.21.15.31:0/2156184101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5078067d70 0x7f507809ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 >> 172.21.15.31:0/2156184101 conn(0x7f5078060ee0 msgr2=0x7f50780a52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 shutdown_connections 2024-04-26T07:28:38.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:38.600+0000 7f507c97a700 1 -- 172.21.15.31:0/2156184101 wait complete. 2024-04-26T07:28:38.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-04-26T07:28:39.531 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:28:39.548 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:28:39.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:28:39.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:28:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.661+0000 7fccffa1c700 1 Processor -- start 2024-04-26T07:28:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.662+0000 7fccffa1c700 1 -- start start 2024-04-26T07:28:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccffa1c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fccf806c7d0 0x7fccf81360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccffa1c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf8096320 0x7fccf805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccffa1c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf80970a0 con 0x7fccf805be60 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccffa1c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf8133c10 con 0x7fccf806c7d0 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccffa1c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8136780 con 0x7fccf8096320 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccfd7b8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fccf806c7d0 0x7fccf81360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccfdfb9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fccf805be60 0x7fccf8140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60954/0 (socket says 172.21.15.31:60954) 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccfdfb9700 1 -- 172.21.15.31:0/1612442674 learned_addr learned my addr 172.21.15.31:0/1612442674 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccfd7b8700 1 -- 172.21.15.31:0/1612442674 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf8096320 msgr2=0x7fccf805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccfd7b8700 1 --2- 172.21.15.31:0/1612442674 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf8096320 0x7fccf805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.663+0000 7fccfd7b8700 1 -- 172.21.15.31:0/1612442674 >> v1:172.21.15.31:6789/0 conn(0x7fccf805be60 legacy=0x7fccf8140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.664+0000 7fcce7fff700 1 -- 172.21.15.31:0/1612442674 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240549719 0 0) 0x7fccf80970a0 con 0x7fccf805be60 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.664+0000 7fccfd7b8700 1 -- 172.21.15.31:0/1612442674 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8136a40 con 0x7fccf806c7d0 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.664+0000 7fccfd7b8700 1 --2- 172.21.15.31:0/1612442674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf806c7d0 0x7fccf81360f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fccf4002f70 tx=0x7fccf4006df0).ready entity=mon.0 client_cookie=abaa9cf8eda78841 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.664+0000 7fcce7fff700 1 -- 172.21.15.31:0/1612442674 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf400d570 con 0x7fccf806c7d0 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.664+0000 7fcce7fff700 1 -- 172.21.15.31:0/1612442674 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4000e90 con 0x7fccf806c7d0 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.664+0000 7fcce7fff700 1 -- 172.21.15.31:0/1612442674 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf400d8c0 con 0x7fccf806c7d0 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.665+0000 7fccffa1c700 1 -- 172.21.15.31:0/1612442674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf806c7d0 msgr2=0x7fccf81360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.665+0000 7fccffa1c700 1 --2- 172.21.15.31:0/1612442674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf806c7d0 0x7fccf81360f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fccf4002f70 tx=0x7fccf4006df0).stop 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.665+0000 7fccffa1c700 1 -- 172.21.15.31:0/1612442674 shutdown_connections 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.665+0000 7fccffa1c700 1 --2- 172.21.15.31:0/1612442674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf806c7d0 0x7fccf81360f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.665+0000 7fccffa1c700 1 --2- 172.21.15.31:0/1612442674 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf8096320 0x7fccf805b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.665+0000 7fccffa1c700 1 -- 172.21.15.31:0/1612442674 >> 172.21.15.31:0/1612442674 conn(0x7fccf8061370 msgr2=0x7fccf806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.665+0000 7fccffa1c700 1 -- 172.21.15.31:0/1612442674 shutdown_connections 2024-04-26T07:28:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.665+0000 7fccffa1c700 1 -- 172.21.15.31:0/1612442674 wait complete. 2024-04-26T07:28:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.666+0000 7fccffa1c700 1 Processor -- start 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.666+0000 7fccffa1c700 1 -- start start 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.667+0000 7fccffa1c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf805be60 0x7fccf809d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.667+0000 7fccffa1c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf806c7d0 0x7fccf81465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.667+0000 7fccffa1c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf8096320 0x7fccf80676f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.667+0000 7fccffa1c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8066dd0 con 0x7fccf8096320 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.667+0000 7fccffa1c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8146110 con 0x7fccf805be60 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.667+0000 7fccffa1c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf809ce70 con 0x7fccf806c7d0 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfd7b8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf805be60 0x7fccf809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfcfb7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf806c7d0 0x7fccf81465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfcfb7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf806c7d0 0x7fccf81465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34710/0 (socket says 172.21.15.31:34710) 2024-04-26T07:28:39.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfd7b8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf805be60 0x7fccf809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43986/0 (socket says 172.21.15.31:43986) 2024-04-26T07:28:39.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfcfb7700 1 -- 172.21.15.31:0/1353594209 learned_addr learned my addr 172.21.15.31:0/1353594209 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:39.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfd7b8700 1 -- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf806c7d0 msgr2=0x7fccf81465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfd7b8700 1 --2- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf806c7d0 0x7fccf81465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfd7b8700 1 -- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf8096320 msgr2=0x7fccf80676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfd7b8700 1 --2- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf8096320 0x7fccf80676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfd7b8700 1 -- 172.21.15.31:0/1353594209 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf400b180 con 0x7fccf805be60 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfcfb7700 1 --2- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf806c7d0 0x7fccf81465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccfd7b8700 1 --2- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf805be60 0x7fccf809d830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fccf4002f70 tx=0x7fccf4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fcce67fc700 1 -- 172.21.15.31:0/1353594209 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf4011a10 con 0x7fccf805be60 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.668+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf8067000 con 0x7fccf805be60 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.669+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf8146a90 con 0x7fccf805be60 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.669+0000 7fcce67fc700 1 -- 172.21.15.31:0/1353594209 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4011b70 con 0x7fccf805be60 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.669+0000 7fcce67fc700 1 -- 172.21.15.31:0/1353594209 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccf4011ce0 con 0x7fccf805be60 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.670+0000 7fcce67fc700 1 -- 172.21.15.31:0/1353594209 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fccf4024020 con 0x7fccf805be60 2024-04-26T07:28:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.670+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd4003410 con 0x7fccf805be60 2024-04-26T07:28:39.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.670+0000 7fcce67fc700 1 -- 172.21.15.31:0/1353594209 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fccf404baf0 con 0x7fccf805be60 2024-04-26T07:28:39.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.676+0000 7fcce67fc700 1 -- 172.21.15.31:0/1353594209 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fccf401fb70 con 0x7fccf805be60 2024-04-26T07:28:39.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.698+0000 7ff3a95ac700 1 Processor -- start 2024-04-26T07:28:39.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.698+0000 7ff3a95ac700 1 -- start start 2024-04-26T07:28:39.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.698+0000 7f082a2e6700 1 Processor -- start 2024-04-26T07:28:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7ff3a95ac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3a405dfb0 0x7ff3a41330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7ff3a95ac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4133590 0x7ff3a4133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7ff3a95ac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a4133f10 con 0x7ff3a4067d70 2024-04-26T07:28:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7ff3a95ac700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a4067580 con 0x7ff3a405dfb0 2024-04-26T07:28:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7ff3a95ac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4066600 con 0x7ff3a4133590 2024-04-26T07:28:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.698+0000 7f082a2e6700 1 -- start start 2024-04-26T07:28:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7f082a2e6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08240a3170 0x7f082409e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7f082a2e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f082409c9e0 0x7f08240a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7f082a2e6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082409e2a0 con 0x7f082409f420 2024-04-26T07:28:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7f082a2e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082409ce70 con 0x7f082409c9e0 2024-04-26T07:28:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7f082a2e6700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f082409d110 con 0x7f08240a3170 2024-04-26T07:28:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7f0828883700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f082409f420 0x7f08240a3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60974/0 (socket says 172.21.15.31:60974) 2024-04-26T07:28:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7f0828883700 1 -- 172.21.15.31:0/1346559247 learned_addr learned my addr 172.21.15.31:0/1346559247 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7ff3a27fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3a405dfb0 0x7ff3a41330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7ff3a27fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3a405dfb0 0x7ff3a41330a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42156/0 (socket says 172.21.15.31:42156) 2024-04-26T07:28:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7ff3a27fc700 1 -- 172.21.15.31:0/2638755237 learned_addr learned my addr 172.21.15.31:0/2638755237 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:39.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.699+0000 7f08237fe700 1 --2- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f082409c9e0 0x7f08240a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f0823fff700 1 --2- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08240a3170 0x7f082409e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f08237fe700 1 -- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08240a3170 msgr2=0x7f082409e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:39.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f08237fe700 1 --2- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08240a3170 0x7f082409e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f08237fe700 1 -- 172.21.15.31:0/1346559247 >> v1:172.21.15.31:6789/0 conn(0x7f082409f420 legacy=0x7f08240a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f08237fe700 1 -- 172.21.15.31:0/1346559247 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082405c4e0 con 0x7f082409c9e0 2024-04-26T07:28:39.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7ff3a27fc700 1 -- 172.21.15.31:0/2638755237 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4133590 msgr2=0x7ff3a4133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:39.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7ff3a27fc700 1 --2- 172.21.15.31:0/2638755237 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4133590 0x7ff3a4133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7ff3a27fc700 1 -- 172.21.15.31:0/2638755237 >> v1:172.21.15.31:6789/0 conn(0x7ff3a4067d70 legacy=0x7ff3a4066e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7ff3a27fc700 1 -- 172.21.15.31:0/2638755237 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a40a4730 con 0x7ff3a405dfb0 2024-04-26T07:28:39.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f0823fff700 1 --2- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08240a3170 0x7f082409e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-26T07:28:39.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f08237fe700 1 --2- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f082409c9e0 0x7f08240a3550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0818002f70 tx=0x7f0818006d80).ready entity=mon.1 client_cookie=fd773e70496f7426 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:39.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7ff3a27fc700 1 --2- 172.21.15.31:0/2638755237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a405dfb0 0x7ff3a41330a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff398002f70 tx=0x7ff398006eb0).ready entity=mon.0 client_cookie=2d4e76193f1d9fff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:39.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f0822ffd700 1 -- 172.21.15.31:0/1346559247 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081800bd20 con 0x7f082409c9e0 2024-04-26T07:28:39.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f0822ffd700 1 -- 172.21.15.31:0/1346559247 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818000e90 con 0x7f082409c9e0 2024-04-26T07:28:39.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.700+0000 7f0822ffd700 1 -- 172.21.15.31:0/1346559247 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08180155e0 con 0x7f082409c9e0 2024-04-26T07:28:39.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7ff3a1ffb700 1 -- 172.21.15.31:0/2638755237 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39800d5c0 con 0x7ff3a405dfb0 2024-04-26T07:28:39.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7ff3a1ffb700 1 -- 172.21.15.31:0/2638755237 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398000e90 con 0x7ff3a405dfb0 2024-04-26T07:28:39.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7ff3a1ffb700 1 -- 172.21.15.31:0/2638755237 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39800d950 con 0x7ff3a405dfb0 2024-04-26T07:28:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7f082a2e6700 1 -- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f082409c9e0 msgr2=0x7f08240a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7f082a2e6700 1 --2- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f082409c9e0 0x7f08240a3550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0818002f70 tx=0x7f0818006d80).stop 2024-04-26T07:28:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7f082a2e6700 1 -- 172.21.15.31:0/1346559247 shutdown_connections 2024-04-26T07:28:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7f082a2e6700 1 --2- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08240a3170 0x7f082409e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7f082a2e6700 1 --2- 172.21.15.31:0/1346559247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f082409c9e0 0x7f08240a3550 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7f082a2e6700 1 -- 172.21.15.31:0/1346559247 >> 172.21.15.31:0/1346559247 conn(0x7f0824060ee0 msgr2=0x7f08240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7f082a2e6700 1 -- 172.21.15.31:0/1346559247 shutdown_connections 2024-04-26T07:28:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.701+0000 7f082a2e6700 1 -- 172.21.15.31:0/1346559247 wait complete. 2024-04-26T07:28:39.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7ff3a95ac700 1 -- 172.21.15.31:0/2638755237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a405dfb0 msgr2=0x7ff3a41330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7ff3a95ac700 1 --2- 172.21.15.31:0/2638755237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a405dfb0 0x7ff3a41330a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff398002f70 tx=0x7ff398006eb0).stop 2024-04-26T07:28:39.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7ff3a95ac700 1 -- 172.21.15.31:0/2638755237 shutdown_connections 2024-04-26T07:28:39.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7ff3a95ac700 1 --2- 172.21.15.31:0/2638755237 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4133590 0x7ff3a4133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7ff3a95ac700 1 --2- 172.21.15.31:0/2638755237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a405dfb0 0x7ff3a41330a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7ff3a95ac700 1 -- 172.21.15.31:0/2638755237 >> 172.21.15.31:0/2638755237 conn(0x7ff3a4060ee0 msgr2=0x7ff3a40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:39.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7ff3a95ac700 1 -- 172.21.15.31:0/2638755237 shutdown_connections 2024-04-26T07:28:39.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7ff3a95ac700 1 -- 172.21.15.31:0/2638755237 wait complete. 2024-04-26T07:28:39.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7f082a2e6700 1 Processor -- start 2024-04-26T07:28:39.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.702+0000 7f082a2e6700 1 -- start start 2024-04-26T07:28:39.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7ff3a95ac700 1 Processor -- start 2024-04-26T07:28:39.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7ff3a95ac700 1 -- start start 2024-04-26T07:28:39.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f082a2e6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f082409f420 0x7f0824091ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f082a2e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08240a3170 0x7f08240a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f082a2e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08240a19f0 0x7f0824066bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f082a2e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824145a90 con 0x7f08240a19f0 2024-04-26T07:28:39.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f082a2e6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0824145d50 con 0x7f08240a3170 2024-04-26T07:28:39.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f082a2e6700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08240a2a20 con 0x7f082409f420 2024-04-26T07:28:39.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f0828883700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08240a19f0 0x7f0824066bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f08237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08240a3170 0x7f08240a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f0828883700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08240a19f0 0x7f0824066bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42168/0 (socket says 172.21.15.31:42168) 2024-04-26T07:28:39.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.703+0000 7f08237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08240a3170 0x7f08240a20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44000/0 (socket says 172.21.15.31:44000) 2024-04-26T07:28:39.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f0828883700 1 -- 172.21.15.31:0/848039313 learned_addr learned my addr 172.21.15.31:0/848039313 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:39.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a95ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3a405dfb0 0x7ff3a4134d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a95ac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4067d70 0x7ff3a4146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a95ac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a4133590 0x7ff3a41464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a95ac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4092420 con 0x7ff3a4133590 2024-04-26T07:28:39.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a95ac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40a2210 con 0x7ff3a405dfb0 2024-04-26T07:28:39.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a95ac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4137110 con 0x7ff3a4067d70 2024-04-26T07:28:39.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a4133590 0x7ff3a41464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f0828883700 1 -- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f082409f420 msgr2=0x7f0824091ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f0828883700 1 --2- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f082409f420 0x7f0824091ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f0828883700 1 -- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08240a3170 msgr2=0x7f08240a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f0828883700 1 --2- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08240a3170 0x7f08240a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f0828883700 1 -- 172.21.15.31:0/848039313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081800d410 con 0x7f08240a19f0 2024-04-26T07:28:39.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a4133590 0x7ff3a41464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42174/0 (socket says 172.21.15.31:42174) 2024-04-26T07:28:39.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a37fe700 1 -- 172.21.15.31:0/1054764611 learned_addr learned my addr 172.21.15.31:0/1054764611 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:39.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a27fc700 1 --2- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4067d70 0x7ff3a4146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f0828883700 1 --2- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08240a19f0 0x7f0824066bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f082409dcc0 tx=0x7f081c007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:39.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f08217fa700 1 -- 172.21.15.31:0/848039313 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c005ba0 con 0x7f08240a19f0 2024-04-26T07:28:39.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a37fe700 1 -- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4067d70 msgr2=0x7ff3a4146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a37fe700 1 --2- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4067d70 0x7ff3a4146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a37fe700 1 -- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3a405dfb0 msgr2=0x7ff3a4134d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T07:28:39.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a37fe700 1 --2- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3a405dfb0 0x7ff3a4134d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7ff3a37fe700 1 -- 172.21.15.31:0/1054764611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39800b1e0 con 0x7ff3a4133590 2024-04-26T07:28:39.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.705+0000 7ff3a37fe700 1 --2- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a4133590 0x7ff3a41464f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff3a4137b50 tx=0x7ff39c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:39.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.704+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0824092a50 con 0x7f08240a19f0 2024-04-26T07:28:39.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.705+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0824145640 con 0x7f08240a19f0 2024-04-26T07:28:39.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.705+0000 7ff393fff700 1 -- 172.21.15.31:0/1054764611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39c00d4a0 con 0x7ff3a4133590 2024-04-26T07:28:39.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.705+0000 7ff393fff700 1 -- 172.21.15.31:0/1054764611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c00d600 con 0x7ff3a4133590 2024-04-26T07:28:39.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.705+0000 7ff393fff700 1 -- 172.21.15.31:0/1054764611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39c00d960 con 0x7ff3a4133590 2024-04-26T07:28:39.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.705+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a4145bd0 con 0x7ff3a4133590 2024-04-26T07:28:39.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.705+0000 7f08217fa700 1 -- 172.21.15.31:0/848039313 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c005d00 con 0x7f08240a19f0 2024-04-26T07:28:39.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.706+0000 7f08217fa700 1 -- 172.21.15.31:0/848039313 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c0072c0 con 0x7f08240a19f0 2024-04-26T07:28:39.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.705+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a40a2600 con 0x7ff3a4133590 2024-04-26T07:28:39.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.706+0000 7f08217fa700 1 -- 172.21.15.31:0/848039313 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f081c01a060 con 0x7f08240a19f0 2024-04-26T07:28:39.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.706+0000 7f08217fa700 1 -- 172.21.15.31:0/848039313 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f081c04a270 con 0x7f08240a19f0 2024-04-26T07:28:39.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.707+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a40a49d0 con 0x7ff3a4133590 2024-04-26T07:28:39.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.707+0000 7ff393fff700 1 -- 172.21.15.31:0/1054764611 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff39c018030 con 0x7ff3a4133590 2024-04-26T07:28:39.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.707+0000 7ff393fff700 1 -- 172.21.15.31:0/1054764611 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff39c04a280 con 0x7ff3a4133590 2024-04-26T07:28:39.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.708+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc003410 con 0x7f08240a19f0 2024-04-26T07:28:39.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.713+0000 7ff393fff700 1 -- 172.21.15.31:0/1054764611 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff39c02f180 con 0x7ff3a4133590 2024-04-26T07:28:39.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.713+0000 7f08217fa700 1 -- 172.21.15.31:0/848039313 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f081c018020 con 0x7f08240a19f0 2024-04-26T07:28:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.742+0000 7fdd1a2c0700 1 Processor -- start 2024-04-26T07:28:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.742+0000 7fdd1a2c0700 1 -- start start 2024-04-26T07:28:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd1a2c0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd1409c7d0 0x7fdd1413b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd1a2c0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd1a2c0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd140a3170 con 0x7fdd140a3660 2024-04-26T07:28:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd1a2c0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1409cf00 con 0x7fdd1409c7d0 2024-04-26T07:28:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd1a2c0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1409eb40 con 0x7fdd1413bbe0 2024-04-26T07:28:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd1885d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd1885d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44010/0 (socket says 172.21.15.31:44010) 2024-04-26T07:28:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd1885d700 1 -- 172.21.15.31:0/3807514093 learned_addr learned my addr 172.21.15.31:0/3807514093 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd13fff700 1 --1- 172.21.15.31:0/3807514093 >> v1:172.21.15.31:6789/0 conn(0x7fdd140a3660 0x7fdd140a3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60982/0 (socket says 172.21.15.31:60982) 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.743+0000 7fdd137fe700 1 --2- 172.21.15.31:0/3807514093 >> v2:172.21.15.31:3300/0 conn(0x7fdd1409c7d0 0x7fdd1413b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.744+0000 7fdd1885d700 1 -- 172.21.15.31:0/3807514093 >> v2:172.21.15.31:3300/0 conn(0x7fdd1409c7d0 msgr2=0x7fdd1413b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.744+0000 7fdd1885d700 1 --2- 172.21.15.31:0/3807514093 >> v2:172.21.15.31:3300/0 conn(0x7fdd1409c7d0 0x7fdd1413b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.744+0000 7fdd1885d700 1 -- 172.21.15.31:0/3807514093 >> v1:172.21.15.31:6789/0 conn(0x7fdd140a3660 legacy=0x7fdd140a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.744+0000 7fdd1885d700 1 -- 172.21.15.31:0/3807514093 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1409e360 con 0x7fdd1413bbe0 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.744+0000 7fdd1885d700 1 --2- 172.21.15.31:0/3807514093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413dfd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdd0c0032f0 tx=0x7fdd0c009290).ready entity=mon.1 client_cookie=58aa7ff3e0c43a14 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.744+0000 7fdd12ffd700 1 -- 172.21.15.31:0/3807514093 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c00b8a0 con 0x7fdd1413bbe0 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.744+0000 7fdd12ffd700 1 -- 172.21.15.31:0/3807514093 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c00ba00 con 0x7fdd1413bbe0 2024-04-26T07:28:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.744+0000 7fdd12ffd700 1 -- 172.21.15.31:0/3807514093 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c00bb70 con 0x7fdd1413bbe0 2024-04-26T07:28:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.745+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/3807514093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 msgr2=0x7fdd1413dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.745+0000 7fdd1a2c0700 1 --2- 172.21.15.31:0/3807514093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413dfd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdd0c0032f0 tx=0x7fdd0c009290).stop 2024-04-26T07:28:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.745+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/3807514093 shutdown_connections 2024-04-26T07:28:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.745+0000 7fdd1a2c0700 1 --2- 172.21.15.31:0/3807514093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413dfd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.745+0000 7fdd1a2c0700 1 --2- 172.21.15.31:0/3807514093 >> v2:172.21.15.31:3300/0 conn(0x7fdd1409c7d0 0x7fdd1413b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.745+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/3807514093 >> 172.21.15.31:0/3807514093 conn(0x7fdd14060ee0 msgr2=0x7fdd140a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.745+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/3807514093 shutdown_connections 2024-04-26T07:28:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.745+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/3807514093 wait complete. 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.746+0000 7fdd1a2c0700 1 Processor -- start 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.746+0000 7fdd1a2c0700 1 -- start start 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd1a2c0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd1409c7d0 0x7fdd14149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd1a2c0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd140a3660 0x7fdd14139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd1a2c0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd1a2c0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14139b80 con 0x7fdd1409c7d0 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd1a2c0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14067930 con 0x7fdd1413bbe0 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd1a2c0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14149980 con 0x7fdd140a3660 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd1409c7d0 0x7fdd14149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd1409c7d0 0x7fdd14149490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42180/0 (socket says 172.21.15.31:42180) 2024-04-26T07:28:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 -- 172.21.15.31:0/1581790806 learned_addr learned my addr 172.21.15.31:0/1581790806 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd1885d700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 -- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd140a3660 msgr2=0x7fdd14139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd140a3660 0x7fdd14139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 -- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 msgr2=0x7fdd1413a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 -- 172.21.15.31:0/1581790806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c009530 con 0x7fdd1409c7d0 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd1885d700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.747+0000 7fdd13fff700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd1409c7d0 0x7fdd14149490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fdd140a96b0 tx=0x7fdd04007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.748+0000 7fdd117fa700 1 -- 172.21.15.31:0/1581790806 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0400ce30 con 0x7fdd1409c7d0 2024-04-26T07:28:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.748+0000 7fdd117fa700 1 -- 172.21.15.31:0/1581790806 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040072e0 con 0x7fdd1409c7d0 2024-04-26T07:28:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.748+0000 7fdd117fa700 1 -- 172.21.15.31:0/1581790806 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd04007450 con 0x7fdd1409c7d0 2024-04-26T07:28:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.748+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd14148fc0 con 0x7fdd1409c7d0 2024-04-26T07:28:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.748+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1413b9d0 con 0x7fdd1409c7d0 2024-04-26T07:28:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.749+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1406bbc0 con 0x7fdd1409c7d0 2024-04-26T07:28:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.749+0000 7fdd117fa700 1 -- 172.21.15.31:0/1581790806 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdd04010070 con 0x7fdd1409c7d0 2024-04-26T07:28:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.750+0000 7fdd117fa700 1 -- 172.21.15.31:0/1581790806 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdd04049f40 con 0x7fdd1409c7d0 2024-04-26T07:28:39.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.755+0000 7fdd117fa700 1 -- 172.21.15.31:0/1581790806 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdd0402ee40 con 0x7fdd1409c7d0 2024-04-26T07:28:39.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.806+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fccd40036c0 con 0x7fccf805be60 2024-04-26T07:28:39.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.806+0000 7fcce67fc700 1 -- 172.21.15.31:0/1353594209 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccf401f9a0 con 0x7fccf805be60 2024-04-26T07:28:39.806 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-04-26T07:28:39.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.808+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 >> v1:172.21.15.31:6816/39613 conn(0x7fccd8038da0 legacy=0x7fccd803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.808+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf805be60 msgr2=0x7fccf809d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.808+0000 7fccffa1c700 1 --2- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf805be60 0x7fccf809d830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fccf4002f70 tx=0x7fccf4015000).stop 2024-04-26T07:28:39.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.809+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 shutdown_connections 2024-04-26T07:28:39.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.809+0000 7fccffa1c700 1 --2- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf8096320 0x7fccf80676f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.809+0000 7fccffa1c700 1 --2- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf805be60 0x7fccf809d830 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.809+0000 7fccffa1c700 1 --2- 172.21.15.31:0/1353594209 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf806c7d0 0x7fccf81465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.809+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 >> 172.21.15.31:0/1353594209 conn(0x7fccf8061370 msgr2=0x7fccf81345d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:39.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.809+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 shutdown_connections 2024-04-26T07:28:39.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.809+0000 7fccffa1c700 1 -- 172.21.15.31:0/1353594209 wait complete. 2024-04-26T07:28:39.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-04-26T07:28:39.823 DEBUG:teuthology.parallel:result is None 2024-04-26T07:28:39.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.835+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07fc0036c0 con 0x7f08240a19f0 2024-04-26T07:28:39.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.836+0000 7f08217fa700 1 -- 172.21.15.31:0/848039313 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f081c018030 con 0x7f08240a19f0 2024-04-26T07:28:39.836 INFO:teuthology.orchestra.run.smithi031.stdout:38654705670 2024-04-26T07:28:39.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.836+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff3a41469e0 con 0x7ff3a4133590 2024-04-26T07:28:39.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7ff393fff700 1 -- 172.21.15.31:0/1054764611 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff39c0327a0 con 0x7ff3a4133590 2024-04-26T07:28:39.837 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-04-26T07:28:39.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 >> v1:172.21.15.31:6816/39613 conn(0x7f0804038e30 legacy=0x7f080403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08240a19f0 msgr2=0x7f0824066bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 --2- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08240a19f0 0x7f0824066bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f082409dcc0 tx=0x7f081c007eb0).stop 2024-04-26T07:28:39.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 shutdown_connections 2024-04-26T07:28:39.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 --2- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f082409f420 0x7f0824091ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 --2- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08240a19f0 0x7f0824066bb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 --2- 172.21.15.31:0/848039313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08240a3170 0x7f08240a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 >> 172.21.15.31:0/848039313 conn(0x7f0824060ee0 msgr2=0x7f082405dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:39.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.837+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 shutdown_connections 2024-04-26T07:28:39.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.838+0000 7f082a2e6700 1 -- 172.21.15.31:0/848039313 wait complete. 2024-04-26T07:28:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.838+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 >> v1:172.21.15.31:6816/39613 conn(0x7ff380038f50 legacy=0x7ff38003b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.838+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a4133590 msgr2=0x7ff3a41464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.838+0000 7ff3a95ac700 1 --2- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a4133590 0x7ff3a41464f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff3a4137b50 tx=0x7ff39c0091a0).stop 2024-04-26T07:28:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.840+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 shutdown_connections 2024-04-26T07:28:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.840+0000 7ff3a95ac700 1 --2- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3a4133590 0x7ff3a41464f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.840+0000 7ff3a95ac700 1 --2- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3a405dfb0 0x7ff3a4134d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.840+0000 7ff3a95ac700 1 --2- 172.21.15.31:0/1054764611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3a4067d70 0x7ff3a4146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.840+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 >> 172.21.15.31:0/1054764611 conn(0x7ff3a4060ee0 msgr2=0x7ff3a4132990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:39.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.840+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 shutdown_connections 2024-04-26T07:28:39.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.840+0000 7ff3a95ac700 1 -- 172.21.15.31:0/1054764611 wait complete. 2024-04-26T07:28:39.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-04-26T07:28:39.849 DEBUG:teuthology.parallel:result is None 2024-04-26T07:28:39.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-04-26T07:28:39.851 DEBUG:teuthology.parallel:result is None 2024-04-26T07:28:39.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.883+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd1409f530 con 0x7fdd1409c7d0 2024-04-26T07:28:39.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.884+0000 7fdd117fa700 1 -- 172.21.15.31:0/1581790806 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd04018030 con 0x7fdd1409c7d0 2024-04-26T07:28:39.884 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 >> v1:172.21.15.31:6816/39613 conn(0x7fdcf4038da0 legacy=0x7fdcf403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd1409c7d0 msgr2=0x7fdd14149490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd1409c7d0 0x7fdd14149490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fdd140a96b0 tx=0x7fdd04007c40).stop 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 shutdown_connections 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd1413bbe0 0x7fdd1413a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd1409c7d0 0x7fdd14149490 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 --2- 172.21.15.31:0/1581790806 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd140a3660 0x7fdd14139e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 >> 172.21.15.31:0/1581790806 conn(0x7fdd14060ee0 msgr2=0x7fdd140a7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 shutdown_connections 2024-04-26T07:28:39.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:39.885+0000 7fdd1a2c0700 1 -- 172.21.15.31:0/1581790806 wait complete. 2024-04-26T07:28:39.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-04-26T07:28:39.896 DEBUG:teuthology.parallel:result is None 2024-04-26T07:28:39.896 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T07:28:39.896 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:28:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.043+0000 7fdc30798700 1 Processor -- start 2024-04-26T07:28:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.043+0000 7fdc30798700 1 -- start start 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc30798700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28134460 0x7fdc28065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc30798700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc28134840 0x7fdc280635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc30798700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28063aa0 0x7fdc2809a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc30798700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc28065770 con 0x7fdc28134840 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc30798700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2809c5e0 con 0x7fdc28063aa0 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc30798700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28134240 con 0x7fdc28134460 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc28134840 0x7fdc280635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2e534700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28134460 0x7fdc28065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc28134840 0x7fdc280635b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42184/0 (socket says 172.21.15.31:42184) 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2ed35700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28063aa0 0x7fdc2809a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 -- 172.21.15.31:0/2082889337 learned_addr learned my addr 172.21.15.31:0/2082889337 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 -- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28134460 msgr2=0x7fdc28065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 --2- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28134460 0x7fdc28065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 -- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28063aa0 msgr2=0x7fdc2809a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 --2- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28063aa0 0x7fdc2809a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 -- 172.21.15.31:0/2082889337 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2809bb10 con 0x7fdc28134840 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2e534700 1 --2- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28134460 0x7fdc28065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2dd33700 1 --2- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134840 0x7fdc280635b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fdc24002f70 tx=0x7fdc24006eb0).ready entity=mon.0 client_cookie=3108c80f2aea36ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.044+0000 7fdc2d532700 1 -- 172.21.15.31:0/2082889337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2400d570 con 0x7fdc28134840 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc2d532700 1 -- 172.21.15.31:0/2082889337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24000e90 con 0x7fdc28134840 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc2d532700 1 -- 172.21.15.31:0/2082889337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2400d900 con 0x7fdc28134840 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 -- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134840 msgr2=0x7fdc280635b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 --2- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134840 0x7fdc280635b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fdc24002f70 tx=0x7fdc24006eb0).stop 2024-04-26T07:28:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 -- 172.21.15.31:0/2082889337 shutdown_connections 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 --2- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28063aa0 0x7fdc2809a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 --2- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28134460 0x7fdc28065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 --2- 172.21.15.31:0/2082889337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134840 0x7fdc280635b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 -- 172.21.15.31:0/2082889337 >> 172.21.15.31:0/2082889337 conn(0x7fdc2805cfb0 msgr2=0x7fdc28062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 -- 172.21.15.31:0/2082889337 shutdown_connections 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.045+0000 7fdc30798700 1 -- 172.21.15.31:0/2082889337 wait complete. 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.046+0000 7fdc30798700 1 Processor -- start 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.046+0000 7fdc30798700 1 -- start start 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc30798700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28063aa0 0x7fdc28092c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc30798700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134460 0x7fdc28136c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc30798700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28134840 0x7fdc28137100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc30798700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28092830 con 0x7fdc28134460 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc30798700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28136260 con 0x7fdc28134840 2024-04-26T07:28:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc30798700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28136500 con 0x7fdc28063aa0 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2dd33700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134460 0x7fdc28136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2dd33700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134460 0x7fdc28136c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42186/0 (socket says 172.21.15.31:42186) 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2e534700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28063aa0 0x7fdc28092c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2dd33700 1 -- 172.21.15.31:0/148763707 learned_addr learned my addr 172.21.15.31:0/148763707 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2ed35700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28134840 0x7fdc28137100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2e534700 1 -- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28134840 msgr2=0x7fdc28137100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2e534700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28134840 0x7fdc28137100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2e534700 1 -- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134460 msgr2=0x7fdc28136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.047+0000 7fdc2e534700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134460 0x7fdc28136c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.048+0000 7fdc2e534700 1 -- 172.21.15.31:0/148763707 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1800b180 con 0x7fdc28063aa0 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.048+0000 7fdc2dd33700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134460 0x7fdc28136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.048+0000 7fdc2e534700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28063aa0 0x7fdc28092c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdc1800c000 tx=0x7fdc18006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.048+0000 7fdc177fe700 1 -- 172.21.15.31:0/148763707 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc18010780 con 0x7fdc28063aa0 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.048+0000 7fdc177fe700 1 -- 172.21.15.31:0/148763707 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180108e0 con 0x7fdc28063aa0 2024-04-26T07:28:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.048+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2400b1e0 con 0x7fdc28063aa0 2024-04-26T07:28:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.048+0000 7fdc177fe700 1 -- 172.21.15.31:0/148763707 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc18010c40 con 0x7fdc28063aa0 2024-04-26T07:28:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.048+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc28137bc0 con 0x7fdc28063aa0 2024-04-26T07:28:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.049+0000 7fdc177fe700 1 -- 172.21.15.31:0/148763707 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdc1801c460 con 0x7fdc28063aa0 2024-04-26T07:28:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.049+0000 7fdc177fe700 1 -- 172.21.15.31:0/148763707 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdc1804ad00 con 0x7fdc28063aa0 2024-04-26T07:28:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.049+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc28133f10 con 0x7fdc28063aa0 2024-04-26T07:28:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.052+0000 7fdc177fe700 1 -- 172.21.15.31:0/148763707 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdc18033630 con 0x7fdc28063aa0 2024-04-26T07:28:40.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.166+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc2806bbc0 con 0x7fdc08038da0 2024-04-26T07:28:40.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.173+0000 7fdc177fe700 1 -- 172.21.15.31:0/148763707 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246899 (unknown 2965378022 0 1524657487) 0x7fdc2806bbc0 con 0x7fdc08038da0 2024-04-26T07:28:40.176 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.175+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 >> v1:172.21.15.31:6816/39613 conn(0x7fdc08038da0 legacy=0x7fdc0803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.175+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28063aa0 msgr2=0x7fdc28092c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.175+0000 7fdc30798700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28063aa0 0x7fdc28092c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdc1800c000 tx=0x7fdc18006df0).stop 2024-04-26T07:28:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.175+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 shutdown_connections 2024-04-26T07:28:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.175+0000 7fdc30798700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdc28063aa0 0x7fdc28092c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.175+0000 7fdc30798700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc28134840 0x7fdc28137100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.175+0000 7fdc30798700 1 --2- 172.21.15.31:0/148763707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc28134460 0x7fdc28136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.175+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 >> 172.21.15.31:0/148763707 conn(0x7fdc2805cfb0 msgr2=0x7fdc2806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.176+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 shutdown_connections 2024-04-26T07:28:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.176+0000 7fdc30798700 1 -- 172.21.15.31:0/148763707 wait complete. 2024-04-26T07:28:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:28:40.186 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T07:28:39.977936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":210658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.840550"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172228+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:31.172228+0000","last_peered":"2024-04-26T07:28:31.172228+0000","last_clean":"2024-04-26T07:28:31.172228+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:31.172228+0000","last_undegraded":"2024-04-26T07:28:31.172228+0000","last_fullsized":"2024-04-26T07:28:31.172228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172127+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:31.172127+0000","last_peered":"2024-04-26T07:28:31.172127+0000","last_clean":"2024-04-26T07:28:31.172127+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:31.172127+0000","last_undegraded":"2024-04-26T07:28:31.172127+0000","last_fullsized":"2024-04-26T07:28:31.172127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187271+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:31.187271+0000","last_peered":"2024-04-26T07:28:31.187271+0000","last_clean":"2024-04-26T07:28:31.187271+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:31.187271+0000","last_undegraded":"2024-04-26T07:28:31.187271+0000","last_fullsized":"2024-04-26T07:28:31.187271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187230+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:31.187230+0000","last_peered":"2024-04-26T07:28:31.187230+0000","last_clean":"2024-04-26T07:28:31.187230+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:31.187230+0000","last_undegraded":"2024-04-26T07:28:31.187230+0000","last_fullsized":"2024-04-26T07:28:31.187230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173249+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:31.173249+0000","last_peered":"2024-04-26T07:28:31.173249+0000","last_clean":"2024-04-26T07:28:31.173249+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:31.173249+0000","last_undegraded":"2024-04-26T07:28:31.173249+0000","last_fullsized":"2024-04-26T07:28:31.173249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162757+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:31.162757+0000","last_peered":"2024-04-26T07:28:31.162757+0000","last_clean":"2024-04-26T07:28:31.162757+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:31.162757+0000","last_undegraded":"2024-04-26T07:28:31.162757+0000","last_fullsized":"2024-04-26T07:28:31.162757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178804+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:31.178804+0000","last_peered":"2024-04-26T07:28:31.178804+0000","last_clean":"2024-04-26T07:28:31.178804+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:31.178804+0000","last_undegraded":"2024-04-26T07:28:31.178804+0000","last_fullsized":"2024-04-26T07:28:31.178804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186018+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:31.186018+0000","last_peered":"2024-04-26T07:28:31.186018+0000","last_clean":"2024-04-26T07:28:31.186018+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:31.186018+0000","last_undegraded":"2024-04-26T07:28:31.186018+0000","last_fullsized":"2024-04-26T07:28:31.186018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175474+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:31.175474+0000","last_peered":"2024-04-26T07:28:31.175474+0000","last_clean":"2024-04-26T07:28:31.175474+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:31.175474+0000","last_undegraded":"2024-04-26T07:28:31.175474+0000","last_fullsized":"2024-04-26T07:28:31.175474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.185784+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:31.185784+0000","last_peered":"2024-04-26T07:28:31.185784+0000","last_clean":"2024-04-26T07:28:31.185784+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:31.185784+0000","last_undegraded":"2024-04-26T07:28:31.185784+0000","last_fullsized":"2024-04-26T07:28:31.185784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.185983+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:31.185983+0000","last_peered":"2024-04-26T07:28:31.185983+0000","last_clean":"2024-04-26T07:28:31.185983+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:31.185983+0000","last_undegraded":"2024-04-26T07:28:31.185983+0000","last_fullsized":"2024-04-26T07:28:31.185983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172567+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:31.172567+0000","last_peered":"2024-04-26T07:28:31.172567+0000","last_clean":"2024-04-26T07:28:31.172567+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:31.172567+0000","last_undegraded":"2024-04-26T07:28:31.172567+0000","last_fullsized":"2024-04-26T07:28:31.172567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172409+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:31.172409+0000","last_peered":"2024-04-26T07:28:31.172409+0000","last_clean":"2024-04-26T07:28:31.172409+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:31.172409+0000","last_undegraded":"2024-04-26T07:28:31.172409+0000","last_fullsized":"2024-04-26T07:28:31.172409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174525+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:31.174525+0000","last_peered":"2024-04-26T07:28:31.174525+0000","last_clean":"2024-04-26T07:28:31.174525+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:31.174525+0000","last_undegraded":"2024-04-26T07:28:31.174525+0000","last_fullsized":"2024-04-26T07:28:31.174525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187530+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:31.187530+0000","last_peered":"2024-04-26T07:28:31.187530+0000","last_clean":"2024-04-26T07:28:31.187530+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:31.187530+0000","last_undegraded":"2024-04-26T07:28:31.187530+0000","last_fullsized":"2024-04-26T07:28:31.187530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178662+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:31.178662+0000","last_peered":"2024-04-26T07:28:31.178662+0000","last_clean":"2024-04-26T07:28:31.178662+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:31.178662+0000","last_undegraded":"2024-04-26T07:28:31.178662+0000","last_fullsized":"2024-04-26T07:28:31.178662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183192+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:31.183192+0000","last_peered":"2024-04-26T07:28:31.183192+0000","last_clean":"2024-04-26T07:28:31.183192+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:31.183192+0000","last_undegraded":"2024-04-26T07:28:31.183192+0000","last_fullsized":"2024-04-26T07:28:31.183192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180790+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:31.180790+0000","last_peered":"2024-04-26T07:28:31.180790+0000","last_clean":"2024-04-26T07:28:31.180790+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:31.180790+0000","last_undegraded":"2024-04-26T07:28:31.180790+0000","last_fullsized":"2024-04-26T07:28:31.180790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172282+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:31.172282+0000","last_peered":"2024-04-26T07:28:31.172282+0000","last_clean":"2024-04-26T07:28:31.172282+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:31.172282+0000","last_undegraded":"2024-04-26T07:28:31.172282+0000","last_fullsized":"2024-04-26T07:28:31.172282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.177992+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:31.177992+0000","last_peered":"2024-04-26T07:28:31.177992+0000","last_clean":"2024-04-26T07:28:31.177992+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:31.177992+0000","last_undegraded":"2024-04-26T07:28:31.177992+0000","last_fullsized":"2024-04-26T07:28:31.177992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.176532+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:31.176532+0000","last_peered":"2024-04-26T07:28:31.176532+0000","last_clean":"2024-04-26T07:28:31.176532+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:31.176532+0000","last_undegraded":"2024-04-26T07:28:31.176532+0000","last_fullsized":"2024-04-26T07:28:31.176532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183286+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:31.183286+0000","last_peered":"2024-04-26T07:28:31.183286+0000","last_clean":"2024-04-26T07:28:31.183286+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:31.183286+0000","last_undegraded":"2024-04-26T07:28:31.183286+0000","last_fullsized":"2024-04-26T07:28:31.183286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178817+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:31.178817+0000","last_peered":"2024-04-26T07:28:31.178817+0000","last_clean":"2024-04-26T07:28:31.178817+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:31.178817+0000","last_undegraded":"2024-04-26T07:28:31.178817+0000","last_fullsized":"2024-04-26T07:28:31.178817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.166215+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:31.166215+0000","last_peered":"2024-04-26T07:28:31.166215+0000","last_clean":"2024-04-26T07:28:31.166215+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:31.166215+0000","last_undegraded":"2024-04-26T07:28:31.166215+0000","last_fullsized":"2024-04-26T07:28:31.166215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175602+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:31.175602+0000","last_peered":"2024-04-26T07:28:31.175602+0000","last_clean":"2024-04-26T07:28:31.175602+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:31.175602+0000","last_undegraded":"2024-04-26T07:28:31.175602+0000","last_fullsized":"2024-04-26T07:28:31.175602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173623+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:31.173623+0000","last_peered":"2024-04-26T07:28:31.173623+0000","last_clean":"2024-04-26T07:28:31.173623+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:31.173623+0000","last_undegraded":"2024-04-26T07:28:31.173623+0000","last_fullsized":"2024-04-26T07:28:31.173623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179180+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:31.179180+0000","last_peered":"2024-04-26T07:28:31.179180+0000","last_clean":"2024-04-26T07:28:31.179180+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:31.179180+0000","last_undegraded":"2024-04-26T07:28:31.179180+0000","last_fullsized":"2024-04-26T07:28:31.179180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.158881+0000","last_change":"2024-04-26T07:28:30.838970+0000","last_active":"2024-04-26T07:28:31.158881+0000","last_peered":"2024-04-26T07:28:31.158881+0000","last_clean":"2024-04-26T07:28:31.158881+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:28:31.158881+0000","last_undegraded":"2024-04-26T07:28:31.158881+0000","last_fullsized":"2024-04-26T07:28:31.158881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179156+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:31.179156+0000","last_peered":"2024-04-26T07:28:31.179156+0000","last_clean":"2024-04-26T07:28:31.179156+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:31.179156+0000","last_undegraded":"2024-04-26T07:28:31.179156+0000","last_fullsized":"2024-04-26T07:28:31.179156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139848+0000","last_change":"2024-04-26T07:28:30.845233+0000","last_active":"2024-04-26T07:28:31.139848+0000","last_peered":"2024-04-26T07:28:31.139848+0000","last_clean":"2024-04-26T07:28:31.139848+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:28:31.139848+0000","last_undegraded":"2024-04-26T07:28:31.139848+0000","last_fullsized":"2024-04-26T07:28:31.139848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187631+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:31.187631+0000","last_peered":"2024-04-26T07:28:31.187631+0000","last_clean":"2024-04-26T07:28:31.187631+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:31.187631+0000","last_undegraded":"2024-04-26T07:28:31.187631+0000","last_fullsized":"2024-04-26T07:28:31.187631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137523+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:32.137523+0000","last_peered":"2024-04-26T07:28:32.137523+0000","last_clean":"2024-04-26T07:28:32.137523+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:32.137523+0000","last_undegraded":"2024-04-26T07:28:32.137523+0000","last_fullsized":"2024-04-26T07:28:32.137523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178874+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:31.178874+0000","last_peered":"2024-04-26T07:28:31.178874+0000","last_clean":"2024-04-26T07:28:31.178874+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:31.178874+0000","last_undegraded":"2024-04-26T07:28:31.178874+0000","last_fullsized":"2024-04-26T07:28:31.178874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848771+0000","last_change":"2024-04-26T07:28:30.850023+0000","last_active":"2024-04-26T07:28:33.848771+0000","last_peered":"2024-04-26T07:28:33.848771+0000","last_clean":"2024-04-26T07:28:33.848771+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:28:33.848771+0000","last_undegraded":"2024-04-26T07:28:33.848771+0000","last_fullsized":"2024-04-26T07:28:33.848771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172685+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:31.172685+0000","last_peered":"2024-04-26T07:28:31.172685+0000","last_clean":"2024-04-26T07:28:31.172685+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:31.172685+0000","last_undegraded":"2024-04-26T07:28:31.172685+0000","last_fullsized":"2024-04-26T07:28:31.172685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.844292+0000","last_change":"2024-04-26T07:28:30.853633+0000","last_active":"2024-04-26T07:28:33.844292+0000","last_peered":"2024-04-26T07:28:33.844292+0000","last_clean":"2024-04-26T07:28:33.844292+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:28:33.844292+0000","last_undegraded":"2024-04-26T07:28:33.844292+0000","last_fullsized":"2024-04-26T07:28:33.844292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178791+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:31.178791+0000","last_peered":"2024-04-26T07:28:31.178791+0000","last_clean":"2024-04-26T07:28:31.178791+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:31.178791+0000","last_undegraded":"2024-04-26T07:28:31.178791+0000","last_fullsized":"2024-04-26T07:28:31.178791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142866+0000","last_change":"2024-04-26T07:28:30.849815+0000","last_active":"2024-04-26T07:28:32.142866+0000","last_peered":"2024-04-26T07:28:32.142866+0000","last_clean":"2024-04-26T07:28:32.142866+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:28:32.142866+0000","last_undegraded":"2024-04-26T07:28:32.142866+0000","last_fullsized":"2024-04-26T07:28:32.142866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174574+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:31.174574+0000","last_peered":"2024-04-26T07:28:31.174574+0000","last_clean":"2024-04-26T07:28:31.174574+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:31.174574+0000","last_undegraded":"2024-04-26T07:28:31.174574+0000","last_fullsized":"2024-04-26T07:28:31.174574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.846821+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:28:33.846821+0000","last_peered":"2024-04-26T07:28:33.846821+0000","last_clean":"2024-04-26T07:28:33.846821+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:28:33.846821+0000","last_undegraded":"2024-04-26T07:28:33.846821+0000","last_fullsized":"2024-04-26T07:28:33.846821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172365+0000","last_change":"2024-04-26T07:28:31.165872+0000","last_active":"2024-04-26T07:28:31.172365+0000","last_peered":"2024-04-26T07:28:31.172365+0000","last_clean":"2024-04-26T07:28:31.172365+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:28:31.172365+0000","last_undegraded":"2024-04-26T07:28:31.172365+0000","last_fullsized":"2024-04-26T07:28:31.172365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849281+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:33.849281+0000","last_peered":"2024-04-26T07:28:33.849281+0000","last_clean":"2024-04-26T07:28:33.849281+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:33.849281+0000","last_undegraded":"2024-04-26T07:28:33.849281+0000","last_fullsized":"2024-04-26T07:28:33.849281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164229+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:31.164229+0000","last_peered":"2024-04-26T07:28:31.164229+0000","last_clean":"2024-04-26T07:28:31.164229+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:31.164229+0000","last_undegraded":"2024-04-26T07:28:31.164229+0000","last_fullsized":"2024-04-26T07:28:31.164229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848433+0000","last_change":"2024-04-26T07:28:30.847060+0000","last_active":"2024-04-26T07:28:33.848433+0000","last_peered":"2024-04-26T07:28:33.848433+0000","last_clean":"2024-04-26T07:28:33.848433+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:28:33.848433+0000","last_undegraded":"2024-04-26T07:28:33.848433+0000","last_fullsized":"2024-04-26T07:28:33.848433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179234+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:31.179234+0000","last_peered":"2024-04-26T07:28:31.179234+0000","last_clean":"2024-04-26T07:28:31.179234+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:31.179234+0000","last_undegraded":"2024-04-26T07:28:31.179234+0000","last_fullsized":"2024-04-26T07:28:31.179234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.137182+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:31.137182+0000","last_peered":"2024-04-26T07:28:31.137182+0000","last_clean":"2024-04-26T07:28:31.137182+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:31.137182+0000","last_undegraded":"2024-04-26T07:28:31.137182+0000","last_fullsized":"2024-04-26T07:28:31.137182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183231+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:31.183231+0000","last_peered":"2024-04-26T07:28:31.183231+0000","last_clean":"2024-04-26T07:28:31.183231+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:31.183231+0000","last_undegraded":"2024-04-26T07:28:31.183231+0000","last_fullsized":"2024-04-26T07:28:31.183231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847615+0000","last_change":"2024-04-26T07:28:30.839424+0000","last_active":"2024-04-26T07:28:33.847615+0000","last_peered":"2024-04-26T07:28:33.847615+0000","last_clean":"2024-04-26T07:28:33.847615+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:28:33.847615+0000","last_undegraded":"2024-04-26T07:28:33.847615+0000","last_fullsized":"2024-04-26T07:28:33.847615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178885+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:31.178885+0000","last_peered":"2024-04-26T07:28:31.178885+0000","last_clean":"2024-04-26T07:28:31.178885+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:31.178885+0000","last_undegraded":"2024-04-26T07:28:31.178885+0000","last_fullsized":"2024-04-26T07:28:31.178885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187942+0000","last_change":"2024-04-26T07:28:30.849542+0000","last_active":"2024-04-26T07:28:31.187942+0000","last_peered":"2024-04-26T07:28:31.187942+0000","last_clean":"2024-04-26T07:28:31.187942+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:28:31.187942+0000","last_undegraded":"2024-04-26T07:28:31.187942+0000","last_fullsized":"2024-04-26T07:28:31.187942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172711+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:31.172711+0000","last_peered":"2024-04-26T07:28:31.172711+0000","last_clean":"2024-04-26T07:28:31.172711+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:31.172711+0000","last_undegraded":"2024-04-26T07:28:31.172711+0000","last_fullsized":"2024-04-26T07:28:31.172711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.176121+0000","last_change":"2024-04-26T07:28:30.853399+0000","last_active":"2024-04-26T07:28:31.176121+0000","last_peered":"2024-04-26T07:28:31.176121+0000","last_clean":"2024-04-26T07:28:31.176121+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:28:31.176121+0000","last_undegraded":"2024-04-26T07:28:31.176121+0000","last_fullsized":"2024-04-26T07:28:31.176121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163472+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:31.163472+0000","last_peered":"2024-04-26T07:28:31.163472+0000","last_clean":"2024-04-26T07:28:31.163472+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:31.163472+0000","last_undegraded":"2024-04-26T07:28:31.163472+0000","last_fullsized":"2024-04-26T07:28:31.163472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172956+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:31.172956+0000","last_peered":"2024-04-26T07:28:31.172956+0000","last_clean":"2024-04-26T07:28:31.172956+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:31.172956+0000","last_undegraded":"2024-04-26T07:28:31.172956+0000","last_fullsized":"2024-04-26T07:28:31.172956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171600+0000","last_change":"2024-04-26T07:28:31.165065+0000","last_active":"2024-04-26T07:28:31.171600+0000","last_peered":"2024-04-26T07:28:31.171600+0000","last_clean":"2024-04-26T07:28:31.171600+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:28:31.171600+0000","last_undegraded":"2024-04-26T07:28:31.171600+0000","last_fullsized":"2024-04-26T07:28:31.171600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146168+0000","last_change":"2024-04-26T07:28:30.844998+0000","last_active":"2024-04-26T07:28:31.146168+0000","last_peered":"2024-04-26T07:28:31.146168+0000","last_clean":"2024-04-26T07:28:31.146168+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:28:31.146168+0000","last_undegraded":"2024-04-26T07:28:31.146168+0000","last_fullsized":"2024-04-26T07:28:31.146168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186075+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:31.186075+0000","last_peered":"2024-04-26T07:28:31.186075+0000","last_clean":"2024-04-26T07:28:31.186075+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:31.186075+0000","last_undegraded":"2024-04-26T07:28:31.186075+0000","last_fullsized":"2024-04-26T07:28:31.186075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848965+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:33.848965+0000","last_peered":"2024-04-26T07:28:33.848965+0000","last_clean":"2024-04-26T07:28:33.848965+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:33.848965+0000","last_undegraded":"2024-04-26T07:28:33.848965+0000","last_fullsized":"2024-04-26T07:28:33.848965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.169765+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:31.169765+0000","last_peered":"2024-04-26T07:28:31.169765+0000","last_clean":"2024-04-26T07:28:31.169765+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:31.169765+0000","last_undegraded":"2024-04-26T07:28:31.169765+0000","last_fullsized":"2024-04-26T07:28:31.169765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139263+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:32.139263+0000","last_peered":"2024-04-26T07:28:32.139263+0000","last_clean":"2024-04-26T07:28:32.139263+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:32.139263+0000","last_undegraded":"2024-04-26T07:28:32.139263+0000","last_fullsized":"2024-04-26T07:28:32.139263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162684+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:31.162684+0000","last_peered":"2024-04-26T07:28:31.162684+0000","last_clean":"2024-04-26T07:28:31.162684+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:31.162684+0000","last_undegraded":"2024-04-26T07:28:31.162684+0000","last_fullsized":"2024-04-26T07:28:31.162684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848488+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:33.848488+0000","last_peered":"2024-04-26T07:28:33.848488+0000","last_clean":"2024-04-26T07:28:33.848488+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:33.848488+0000","last_undegraded":"2024-04-26T07:28:33.848488+0000","last_fullsized":"2024-04-26T07:28:33.848488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172151+0000","last_change":"2024-04-26T07:28:31.164112+0000","last_active":"2024-04-26T07:28:31.172151+0000","last_peered":"2024-04-26T07:28:31.172151+0000","last_clean":"2024-04-26T07:28:31.172151+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:28:31.172151+0000","last_undegraded":"2024-04-26T07:28:31.172151+0000","last_fullsized":"2024-04-26T07:28:31.172151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849342+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:33.849342+0000","last_peered":"2024-04-26T07:28:33.849342+0000","last_clean":"2024-04-26T07:28:33.849342+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:33.849342+0000","last_undegraded":"2024-04-26T07:28:33.849342+0000","last_fullsized":"2024-04-26T07:28:33.849342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175642+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:31.175642+0000","last_peered":"2024-04-26T07:28:31.175642+0000","last_clean":"2024-04-26T07:28:31.175642+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:31.175642+0000","last_undegraded":"2024-04-26T07:28:31.175642+0000","last_fullsized":"2024-04-26T07:28:31.175642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.147037+0000","last_change":"2024-04-26T07:28:22.650334+0000","last_active":"2024-04-26T07:28:31.147037+0000","last_peered":"2024-04-26T07:28:31.147037+0000","last_clean":"2024-04-26T07:28:31.147037+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:28:31.147037+0000","last_undegraded":"2024-04-26T07:28:31.147037+0000","last_fullsized":"2024-04-26T07:28:31.147037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140042+0000","last_change":"2024-04-26T07:28:30.851175+0000","last_active":"2024-04-26T07:28:32.140042+0000","last_peered":"2024-04-26T07:28:32.140042+0000","last_clean":"2024-04-26T07:28:32.140042+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:28:32.140042+0000","last_undegraded":"2024-04-26T07:28:32.140042+0000","last_fullsized":"2024-04-26T07:28:32.140042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174550+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:31.174550+0000","last_peered":"2024-04-26T07:28:31.174550+0000","last_clean":"2024-04-26T07:28:31.174550+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:31.174550+0000","last_undegraded":"2024-04-26T07:28:31.174550+0000","last_fullsized":"2024-04-26T07:28:31.174550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139938+0000","last_change":"2024-04-26T07:28:22.023450+0000","last_active":"2024-04-26T07:28:31.139938+0000","last_peered":"2024-04-26T07:28:31.139938+0000","last_clean":"2024-04-26T07:28:31.139938+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:28:31.139938+0000","last_undegraded":"2024-04-26T07:28:31.139938+0000","last_fullsized":"2024-04-26T07:28:31.139938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847520+0000","last_change":"2024-04-26T07:28:30.853616+0000","last_active":"2024-04-26T07:28:33.847520+0000","last_peered":"2024-04-26T07:28:33.847520+0000","last_clean":"2024-04-26T07:28:33.847520+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:28:33.847520+0000","last_undegraded":"2024-04-26T07:28:33.847520+0000","last_fullsized":"2024-04-26T07:28:33.847520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163132+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:31.163132+0000","last_peered":"2024-04-26T07:28:31.163132+0000","last_clean":"2024-04-26T07:28:31.163132+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:31.163132+0000","last_undegraded":"2024-04-26T07:28:31.163132+0000","last_fullsized":"2024-04-26T07:28:31.163132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146597+0000","last_change":"2024-04-26T07:28:22.024031+0000","last_active":"2024-04-26T07:28:31.146597+0000","last_peered":"2024-04-26T07:28:31.146597+0000","last_clean":"2024-04-26T07:28:31.146597+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:28:31.146597+0000","last_undegraded":"2024-04-26T07:28:31.146597+0000","last_fullsized":"2024-04-26T07:28:31.146597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138018+0000","last_change":"2024-04-26T07:28:30.839738+0000","last_active":"2024-04-26T07:28:32.138018+0000","last_peered":"2024-04-26T07:28:32.138018+0000","last_clean":"2024-04-26T07:28:32.138018+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:28:32.138018+0000","last_undegraded":"2024-04-26T07:28:32.138018+0000","last_fullsized":"2024-04-26T07:28:32.138018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186048+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:31.186048+0000","last_peered":"2024-04-26T07:28:31.186048+0000","last_clean":"2024-04-26T07:28:31.186048+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:31.186048+0000","last_undegraded":"2024-04-26T07:28:31.186048+0000","last_fullsized":"2024-04-26T07:28:31.186048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139873+0000","last_change":"2024-04-26T07:28:22.023795+0000","last_active":"2024-04-26T07:28:31.139873+0000","last_peered":"2024-04-26T07:28:31.139873+0000","last_clean":"2024-04-26T07:28:31.139873+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:28:31.139873+0000","last_undegraded":"2024-04-26T07:28:31.139873+0000","last_fullsized":"2024-04-26T07:28:31.139873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140354+0000","last_change":"2024-04-26T07:28:18.549478+0000","last_active":"2024-04-26T07:28:31.140354+0000","last_peered":"2024-04-26T07:28:31.140354+0000","last_clean":"2024-04-26T07:28:31.140354+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:28:31.140354+0000","last_undegraded":"2024-04-26T07:28:31.140354+0000","last_fullsized":"2024-04-26T07:28:31.140354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_clean_scrub_stamp":"2024-04-26T07:28:14.971410+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.135798+0000","last_change":"2024-04-26T07:28:30.859261+0000","last_active":"2024-04-26T07:28:31.135798+0000","last_peered":"2024-04-26T07:28:31.135798+0000","last_clean":"2024-04-26T07:28:31.135798+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:28:31.135798+0000","last_undegraded":"2024-04-26T07:28:31.135798+0000","last_fullsized":"2024-04-26T07:28:31.135798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179112+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:31.179112+0000","last_peered":"2024-04-26T07:28:31.179112+0000","last_clean":"2024-04-26T07:28:31.179112+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:31.179112+0000","last_undegraded":"2024-04-26T07:28:31.179112+0000","last_fullsized":"2024-04-26T07:28:31.179112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136584+0000","last_change":"2024-04-26T07:28:22.026306+0000","last_active":"2024-04-26T07:28:31.136584+0000","last_peered":"2024-04-26T07:28:31.136584+0000","last_clean":"2024-04-26T07:28:31.136584+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:28:31.136584+0000","last_undegraded":"2024-04-26T07:28:31.136584+0000","last_fullsized":"2024-04-26T07:28:31.136584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142616+0000","last_change":"2024-04-26T07:28:30.854930+0000","last_active":"2024-04-26T07:28:32.142616+0000","last_peered":"2024-04-26T07:28:32.142616+0000","last_clean":"2024-04-26T07:28:32.142616+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:28:32.142616+0000","last_undegraded":"2024-04-26T07:28:32.142616+0000","last_fullsized":"2024-04-26T07:28:32.142616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186614+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:31.186614+0000","last_peered":"2024-04-26T07:28:31.186614+0000","last_clean":"2024-04-26T07:28:31.186614+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:31.186614+0000","last_undegraded":"2024-04-26T07:28:31.186614+0000","last_fullsized":"2024-04-26T07:28:31.186614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.149451+0000","last_change":"2024-04-26T07:28:22.650352+0000","last_active":"2024-04-26T07:28:31.149451+0000","last_peered":"2024-04-26T07:28:31.149451+0000","last_clean":"2024-04-26T07:28:31.149451+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:28:31.149451+0000","last_undegraded":"2024-04-26T07:28:31.149451+0000","last_fullsized":"2024-04-26T07:28:31.149451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140458+0000","last_change":"2024-04-26T07:28:30.844050+0000","last_active":"2024-04-26T07:28:31.140458+0000","last_peered":"2024-04-26T07:28:31.140458+0000","last_clean":"2024-04-26T07:28:31.140458+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:28:31.140458+0000","last_undegraded":"2024-04-26T07:28:31.140458+0000","last_fullsized":"2024-04-26T07:28:31.140458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180827+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:31.180827+0000","last_peered":"2024-04-26T07:28:31.180827+0000","last_clean":"2024-04-26T07:28:31.180827+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:31.180827+0000","last_undegraded":"2024-04-26T07:28:31.180827+0000","last_fullsized":"2024-04-26T07:28:31.180827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847920+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:33.847920+0000","last_peered":"2024-04-26T07:28:33.847920+0000","last_clean":"2024-04-26T07:28:33.847920+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:33.847920+0000","last_undegraded":"2024-04-26T07:28:33.847920+0000","last_fullsized":"2024-04-26T07:28:33.847920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140850+0000","last_change":"2024-04-26T07:28:22.650310+0000","last_active":"2024-04-26T07:28:31.140850+0000","last_peered":"2024-04-26T07:28:31.140850+0000","last_clean":"2024-04-26T07:28:31.140850+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:28:31.140850+0000","last_undegraded":"2024-04-26T07:28:31.140850+0000","last_fullsized":"2024-04-26T07:28:31.140850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172737+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:31.172737+0000","last_peered":"2024-04-26T07:28:31.172737+0000","last_clean":"2024-04-26T07:28:31.172737+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:31.172737+0000","last_undegraded":"2024-04-26T07:28:31.172737+0000","last_fullsized":"2024-04-26T07:28:31.172737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.142937+0000","last_change":"2024-04-26T07:28:22.650378+0000","last_active":"2024-04-26T07:28:31.142937+0000","last_peered":"2024-04-26T07:28:31.142937+0000","last_clean":"2024-04-26T07:28:31.142937+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:28:31.142937+0000","last_undegraded":"2024-04-26T07:28:31.142937+0000","last_fullsized":"2024-04-26T07:28:31.142937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142805+0000","last_change":"2024-04-26T07:28:30.848849+0000","last_active":"2024-04-26T07:28:32.142805+0000","last_peered":"2024-04-26T07:28:32.142805+0000","last_clean":"2024-04-26T07:28:32.142805+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:28:32.142805+0000","last_undegraded":"2024-04-26T07:28:32.142805+0000","last_fullsized":"2024-04-26T07:28:32.142805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172185+0000","last_change":"2024-04-26T07:28:31.160967+0000","last_active":"2024-04-26T07:28:31.172185+0000","last_peered":"2024-04-26T07:28:31.172185+0000","last_clean":"2024-04-26T07:28:31.172185+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:28:31.172185+0000","last_undegraded":"2024-04-26T07:28:31.172185+0000","last_fullsized":"2024-04-26T07:28:31.172185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849877+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:33.849877+0000","last_peered":"2024-04-26T07:28:33.849877+0000","last_clean":"2024-04-26T07:28:33.849877+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:33.849877+0000","last_undegraded":"2024-04-26T07:28:33.849877+0000","last_fullsized":"2024-04-26T07:28:33.849877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.161796+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:31.161796+0000","last_peered":"2024-04-26T07:28:31.161796+0000","last_clean":"2024-04-26T07:28:31.161796+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:31.161796+0000","last_undegraded":"2024-04-26T07:28:31.161796+0000","last_fullsized":"2024-04-26T07:28:31.161796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178894+0000","last_change":"2024-04-26T07:28:30.852699+0000","last_active":"2024-04-26T07:28:31.178894+0000","last_peered":"2024-04-26T07:28:31.178894+0000","last_clean":"2024-04-26T07:28:31.178894+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:28:31.178894+0000","last_undegraded":"2024-04-26T07:28:31.178894+0000","last_fullsized":"2024-04-26T07:28:31.178894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172388+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:31.172388+0000","last_peered":"2024-04-26T07:28:31.172388+0000","last_clean":"2024-04-26T07:28:31.172388+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:31.172388+0000","last_undegraded":"2024-04-26T07:28:31.172388+0000","last_fullsized":"2024-04-26T07:28:31.172388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.177540+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:31.177540+0000","last_peered":"2024-04-26T07:28:31.177540+0000","last_clean":"2024-04-26T07:28:31.177540+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:31.177540+0000","last_undegraded":"2024-04-26T07:28:31.177540+0000","last_fullsized":"2024-04-26T07:28:31.177540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171622+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:31.171622+0000","last_peered":"2024-04-26T07:28:31.171622+0000","last_clean":"2024-04-26T07:28:31.171622+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:31.171622+0000","last_undegraded":"2024-04-26T07:28:31.171622+0000","last_fullsized":"2024-04-26T07:28:31.171622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.156602+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:31.156602+0000","last_peered":"2024-04-26T07:28:31.156602+0000","last_clean":"2024-04-26T07:28:31.156602+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:31.156602+0000","last_undegraded":"2024-04-26T07:28:31.156602+0000","last_fullsized":"2024-04-26T07:28:31.156602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162955+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:31.162955+0000","last_peered":"2024-04-26T07:28:31.162955+0000","last_clean":"2024-04-26T07:28:31.162955+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:31.162955+0000","last_undegraded":"2024-04-26T07:28:31.162955+0000","last_fullsized":"2024-04-26T07:28:31.162955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187941+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:31.187941+0000","last_peered":"2024-04-26T07:28:31.187941+0000","last_clean":"2024-04-26T07:28:31.187941+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:31.187941+0000","last_undegraded":"2024-04-26T07:28:31.187941+0000","last_fullsized":"2024-04-26T07:28:31.187941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171434+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:31.171434+0000","last_peered":"2024-04-26T07:28:31.171434+0000","last_clean":"2024-04-26T07:28:31.171434+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:31.171434+0000","last_undegraded":"2024-04-26T07:28:31.171434+0000","last_fullsized":"2024-04-26T07:28:31.171434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.166241+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:31.166241+0000","last_peered":"2024-04-26T07:28:31.166241+0000","last_clean":"2024-04-26T07:28:31.166241+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:31.166241+0000","last_undegraded":"2024-04-26T07:28:31.166241+0000","last_fullsized":"2024-04-26T07:28:31.166241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162933+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:31.162933+0000","last_peered":"2024-04-26T07:28:31.162933+0000","last_clean":"2024-04-26T07:28:31.162933+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:31.162933+0000","last_undegraded":"2024-04-26T07:28:31.162933+0000","last_fullsized":"2024-04-26T07:28:31.162933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.169782+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:31.169782+0000","last_peered":"2024-04-26T07:28:31.169782+0000","last_clean":"2024-04-26T07:28:31.169782+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:31.169782+0000","last_undegraded":"2024-04-26T07:28:31.169782+0000","last_fullsized":"2024-04-26T07:28:31.169782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164315+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:31.164315+0000","last_peered":"2024-04-26T07:28:31.164315+0000","last_clean":"2024-04-26T07:28:31.164315+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:31.164315+0000","last_undegraded":"2024-04-26T07:28:31.164315+0000","last_fullsized":"2024-04-26T07:28:31.164315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173981+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:31.173981+0000","last_peered":"2024-04-26T07:28:31.173981+0000","last_clean":"2024-04-26T07:28:31.173981+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:31.173981+0000","last_undegraded":"2024-04-26T07:28:31.173981+0000","last_fullsized":"2024-04-26T07:28:31.173981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":52764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.193}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]}]}]}} 2024-04-26T07:28:40.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:28:40.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f16a2e700 1 Processor -- start 2024-04-26T07:28:40.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f16a2e700 1 -- start start 2024-04-26T07:28:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f16a2e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f101360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f16a2e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f10096320 0x7f9f1005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f16a2e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f100970a0 con 0x7f9f1005be60 2024-04-26T07:28:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f16a2e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f10133c10 con 0x7f9f10096320 2024-04-26T07:28:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f16a2e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10136780 con 0x7f9f1006c7d0 2024-04-26T07:28:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f0f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f10096320 0x7f9f1005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f101360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f14fcb700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9f1005be60 0x7f9f10140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60990/0 (socket says 172.21.15.31:60990) 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f0f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f10096320 0x7f9f1005b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42198/0 (socket says 172.21.15.31:42198) 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f101360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34788/0 (socket says 172.21.15.31:34788) 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.333+0000 7f9f14fcb700 1 -- 172.21.15.31:0/1747627405 learned_addr learned my addr 172.21.15.31:0/1747627405 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0f7fe700 1 -- 172.21.15.31:0/1747627405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 msgr2=0x7f9f101360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0f7fe700 1 --2- 172.21.15.31:0/1747627405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f101360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0f7fe700 1 -- 172.21.15.31:0/1747627405 >> v1:172.21.15.31:6789/0 conn(0x7f9f1005be60 legacy=0x7f9f10140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0f7fe700 1 -- 172.21.15.31:0/1747627405 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f10136a40 con 0x7f9f10096320 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0effd700 1 -- 172.21.15.31:0/1747627405 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427879849 0 0) 0x7f9f100970a0 con 0x7f9f1005be60 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0ffff700 1 --2- 172.21.15.31:0/1747627405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f101360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0f7fe700 1 --2- 172.21.15.31:0/1747627405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f10096320 0x7f9f1005b970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9f04002f70 tx=0x7f9f04006df0).ready entity=mon.0 client_cookie=d46ca4f77fd5c06d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0effd700 1 -- 172.21.15.31:0/1747627405 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f0400d570 con 0x7f9f10096320 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0effd700 1 -- 172.21.15.31:0/1747627405 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04000e90 con 0x7f9f10096320 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f0effd700 1 -- 172.21.15.31:0/1747627405 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f0400d8c0 con 0x7f9f10096320 2024-04-26T07:28:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f16a2e700 1 -- 172.21.15.31:0/1747627405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f10096320 msgr2=0x7f9f1005b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f16a2e700 1 --2- 172.21.15.31:0/1747627405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f10096320 0x7f9f1005b970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9f04002f70 tx=0x7f9f04006df0).stop 2024-04-26T07:28:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f16a2e700 1 -- 172.21.15.31:0/1747627405 shutdown_connections 2024-04-26T07:28:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f16a2e700 1 --2- 172.21.15.31:0/1747627405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f101360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f16a2e700 1 --2- 172.21.15.31:0/1747627405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f10096320 0x7f9f1005b970 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.334+0000 7f9f16a2e700 1 -- 172.21.15.31:0/1747627405 >> 172.21.15.31:0/1747627405 conn(0x7f9f10061370 msgr2=0x7f9f1006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.335+0000 7f9f16a2e700 1 -- 172.21.15.31:0/1747627405 shutdown_connections 2024-04-26T07:28:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.335+0000 7f9f16a2e700 1 -- 172.21.15.31:0/1747627405 wait complete. 2024-04-26T07:28:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.335+0000 7f9f16a2e700 1 Processor -- start 2024-04-26T07:28:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f16a2e700 1 -- start start 2024-04-26T07:28:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f16a2e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1005be60 0x7f9f10066b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f16a2e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f10148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f16a2e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f10096320 0x7f9f10149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f16a2e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10064110 con 0x7f9f1005be60 2024-04-26T07:28:40.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f16a2e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100643d0 con 0x7f9f10096320 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f16a2e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10066620 con 0x7f9f1006c7d0 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f0f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f10148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1005be60 0x7f9f10066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1005be60 0x7f9f10066b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42202/0 (socket says 172.21.15.31:42202) 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f0f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f10148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34804/0 (socket says 172.21.15.31:34804) 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f0ffff700 1 -- 172.21.15.31:0/2501987805 learned_addr learned my addr 172.21.15.31:0/2501987805 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.336+0000 7f9f14fcb700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f10096320 0x7f9f10149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0ffff700 1 -- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 msgr2=0x7f9f10148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0ffff700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f10148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0ffff700 1 -- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f10096320 msgr2=0x7f9f10149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0ffff700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f10096320 0x7f9f10149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0ffff700 1 -- 172.21.15.31:0/2501987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0000b180 con 0x7f9f1005be60 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0f7fe700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f10148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f14fcb700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f10096320 0x7f9f10149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0ffff700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1005be60 0x7f9f10066b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f9f0000c000 tx=0x7f9f00006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0d7fa700 1 -- 172.21.15.31:0/2501987805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f0000c7e0 con 0x7f9f1005be60 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0d7fa700 1 -- 172.21.15.31:0/2501987805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0000c940 con 0x7f9f1005be60 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0400b180 con 0x7f9f1005be60 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f0d7fa700 1 -- 172.21.15.31:0/2501987805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f0000cca0 con 0x7f9f1005be60 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.337+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f10067e30 con 0x7f9f1005be60 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.338+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f100975a0 con 0x7f9f1005be60 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.338+0000 7f9f0d7fa700 1 -- 172.21.15.31:0/2501987805 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9f0001c460 con 0x7f9f1005be60 2024-04-26T07:28:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.338+0000 7f9f0d7fa700 1 -- 172.21.15.31:0/2501987805 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9f0004ae00 con 0x7f9f1005be60 2024-04-26T07:28:40.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.341+0000 7f9f0d7fa700 1 -- 172.21.15.31:0/2501987805 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9f00033730 con 0x7f9f1005be60 2024-04-26T07:28:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.456+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f10097f90 con 0x7f9ef0038da0 2024-04-26T07:28:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.462+0000 7f9f0d7fa700 1 -- 172.21.15.31:0/2501987805 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246899 (unknown 2965378022 0 1524657487) 0x7f9f10097f90 con 0x7f9ef0038da0 2024-04-26T07:28:40.466 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 >> v1:172.21.15.31:6816/39613 conn(0x7f9ef0038da0 legacy=0x7f9ef003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1005be60 msgr2=0x7f9f10066b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1005be60 0x7f9f10066b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f9f0000c000 tx=0x7f9f00006df0).stop 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 shutdown_connections 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f10096320 0x7f9f10149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1005be60 0x7f9f10066b20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 --2- 172.21.15.31:0/2501987805 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f1006c7d0 0x7f9f10148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 >> 172.21.15.31:0/2501987805 conn(0x7f9f10061370 msgr2=0x7f9f10099810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.464+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 shutdown_connections 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.465+0000 7f9f16a2e700 1 -- 172.21.15.31:0/2501987805 wait complete. 2024-04-26T07:28:40.468 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:28:40.475 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T07:28:39.977936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":210658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.840550"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172228+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:31.172228+0000","last_peered":"2024-04-26T07:28:31.172228+0000","last_clean":"2024-04-26T07:28:31.172228+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:31.172228+0000","last_undegraded":"2024-04-26T07:28:31.172228+0000","last_fullsized":"2024-04-26T07:28:31.172228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172127+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:31.172127+0000","last_peered":"2024-04-26T07:28:31.172127+0000","last_clean":"2024-04-26T07:28:31.172127+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:31.172127+0000","last_undegraded":"2024-04-26T07:28:31.172127+0000","last_fullsized":"2024-04-26T07:28:31.172127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187271+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:31.187271+0000","last_peered":"2024-04-26T07:28:31.187271+0000","last_clean":"2024-04-26T07:28:31.187271+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:31.187271+0000","last_undegraded":"2024-04-26T07:28:31.187271+0000","last_fullsized":"2024-04-26T07:28:31.187271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187230+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:31.187230+0000","last_peered":"2024-04-26T07:28:31.187230+0000","last_clean":"2024-04-26T07:28:31.187230+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:31.187230+0000","last_undegraded":"2024-04-26T07:28:31.187230+0000","last_fullsized":"2024-04-26T07:28:31.187230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173249+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:31.173249+0000","last_peered":"2024-04-26T07:28:31.173249+0000","last_clean":"2024-04-26T07:28:31.173249+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:31.173249+0000","last_undegraded":"2024-04-26T07:28:31.173249+0000","last_fullsized":"2024-04-26T07:28:31.173249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162757+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:31.162757+0000","last_peered":"2024-04-26T07:28:31.162757+0000","last_clean":"2024-04-26T07:28:31.162757+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:31.162757+0000","last_undegraded":"2024-04-26T07:28:31.162757+0000","last_fullsized":"2024-04-26T07:28:31.162757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178804+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:31.178804+0000","last_peered":"2024-04-26T07:28:31.178804+0000","last_clean":"2024-04-26T07:28:31.178804+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:31.178804+0000","last_undegraded":"2024-04-26T07:28:31.178804+0000","last_fullsized":"2024-04-26T07:28:31.178804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186018+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:31.186018+0000","last_peered":"2024-04-26T07:28:31.186018+0000","last_clean":"2024-04-26T07:28:31.186018+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:31.186018+0000","last_undegraded":"2024-04-26T07:28:31.186018+0000","last_fullsized":"2024-04-26T07:28:31.186018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175474+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:31.175474+0000","last_peered":"2024-04-26T07:28:31.175474+0000","last_clean":"2024-04-26T07:28:31.175474+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:31.175474+0000","last_undegraded":"2024-04-26T07:28:31.175474+0000","last_fullsized":"2024-04-26T07:28:31.175474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.185784+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:31.185784+0000","last_peered":"2024-04-26T07:28:31.185784+0000","last_clean":"2024-04-26T07:28:31.185784+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:31.185784+0000","last_undegraded":"2024-04-26T07:28:31.185784+0000","last_fullsized":"2024-04-26T07:28:31.185784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.185983+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:31.185983+0000","last_peered":"2024-04-26T07:28:31.185983+0000","last_clean":"2024-04-26T07:28:31.185983+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:31.185983+0000","last_undegraded":"2024-04-26T07:28:31.185983+0000","last_fullsized":"2024-04-26T07:28:31.185983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172567+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:31.172567+0000","last_peered":"2024-04-26T07:28:31.172567+0000","last_clean":"2024-04-26T07:28:31.172567+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:31.172567+0000","last_undegraded":"2024-04-26T07:28:31.172567+0000","last_fullsized":"2024-04-26T07:28:31.172567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172409+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:31.172409+0000","last_peered":"2024-04-26T07:28:31.172409+0000","last_clean":"2024-04-26T07:28:31.172409+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:31.172409+0000","last_undegraded":"2024-04-26T07:28:31.172409+0000","last_fullsized":"2024-04-26T07:28:31.172409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174525+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:31.174525+0000","last_peered":"2024-04-26T07:28:31.174525+0000","last_clean":"2024-04-26T07:28:31.174525+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:31.174525+0000","last_undegraded":"2024-04-26T07:28:31.174525+0000","last_fullsized":"2024-04-26T07:28:31.174525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187530+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:31.187530+0000","last_peered":"2024-04-26T07:28:31.187530+0000","last_clean":"2024-04-26T07:28:31.187530+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:31.187530+0000","last_undegraded":"2024-04-26T07:28:31.187530+0000","last_fullsized":"2024-04-26T07:28:31.187530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178662+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:31.178662+0000","last_peered":"2024-04-26T07:28:31.178662+0000","last_clean":"2024-04-26T07:28:31.178662+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:31.178662+0000","last_undegraded":"2024-04-26T07:28:31.178662+0000","last_fullsized":"2024-04-26T07:28:31.178662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183192+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:31.183192+0000","last_peered":"2024-04-26T07:28:31.183192+0000","last_clean":"2024-04-26T07:28:31.183192+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:31.183192+0000","last_undegraded":"2024-04-26T07:28:31.183192+0000","last_fullsized":"2024-04-26T07:28:31.183192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180790+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:31.180790+0000","last_peered":"2024-04-26T07:28:31.180790+0000","last_clean":"2024-04-26T07:28:31.180790+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:31.180790+0000","last_undegraded":"2024-04-26T07:28:31.180790+0000","last_fullsized":"2024-04-26T07:28:31.180790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172282+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:31.172282+0000","last_peered":"2024-04-26T07:28:31.172282+0000","last_clean":"2024-04-26T07:28:31.172282+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:31.172282+0000","last_undegraded":"2024-04-26T07:28:31.172282+0000","last_fullsized":"2024-04-26T07:28:31.172282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.177992+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:31.177992+0000","last_peered":"2024-04-26T07:28:31.177992+0000","last_clean":"2024-04-26T07:28:31.177992+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:31.177992+0000","last_undegraded":"2024-04-26T07:28:31.177992+0000","last_fullsized":"2024-04-26T07:28:31.177992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.176532+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:31.176532+0000","last_peered":"2024-04-26T07:28:31.176532+0000","last_clean":"2024-04-26T07:28:31.176532+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:31.176532+0000","last_undegraded":"2024-04-26T07:28:31.176532+0000","last_fullsized":"2024-04-26T07:28:31.176532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183286+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:31.183286+0000","last_peered":"2024-04-26T07:28:31.183286+0000","last_clean":"2024-04-26T07:28:31.183286+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:31.183286+0000","last_undegraded":"2024-04-26T07:28:31.183286+0000","last_fullsized":"2024-04-26T07:28:31.183286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178817+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:31.178817+0000","last_peered":"2024-04-26T07:28:31.178817+0000","last_clean":"2024-04-26T07:28:31.178817+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:31.178817+0000","last_undegraded":"2024-04-26T07:28:31.178817+0000","last_fullsized":"2024-04-26T07:28:31.178817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.166215+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:31.166215+0000","last_peered":"2024-04-26T07:28:31.166215+0000","last_clean":"2024-04-26T07:28:31.166215+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:31.166215+0000","last_undegraded":"2024-04-26T07:28:31.166215+0000","last_fullsized":"2024-04-26T07:28:31.166215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175602+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:31.175602+0000","last_peered":"2024-04-26T07:28:31.175602+0000","last_clean":"2024-04-26T07:28:31.175602+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:31.175602+0000","last_undegraded":"2024-04-26T07:28:31.175602+0000","last_fullsized":"2024-04-26T07:28:31.175602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173623+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:31.173623+0000","last_peered":"2024-04-26T07:28:31.173623+0000","last_clean":"2024-04-26T07:28:31.173623+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:31.173623+0000","last_undegraded":"2024-04-26T07:28:31.173623+0000","last_fullsized":"2024-04-26T07:28:31.173623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179180+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:31.179180+0000","last_peered":"2024-04-26T07:28:31.179180+0000","last_clean":"2024-04-26T07:28:31.179180+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:31.179180+0000","last_undegraded":"2024-04-26T07:28:31.179180+0000","last_fullsized":"2024-04-26T07:28:31.179180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.158881+0000","last_change":"2024-04-26T07:28:30.838970+0000","last_active":"2024-04-26T07:28:31.158881+0000","last_peered":"2024-04-26T07:28:31.158881+0000","last_clean":"2024-04-26T07:28:31.158881+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:28:31.158881+0000","last_undegraded":"2024-04-26T07:28:31.158881+0000","last_fullsized":"2024-04-26T07:28:31.158881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179156+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:31.179156+0000","last_peered":"2024-04-26T07:28:31.179156+0000","last_clean":"2024-04-26T07:28:31.179156+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:31.179156+0000","last_undegraded":"2024-04-26T07:28:31.179156+0000","last_fullsized":"2024-04-26T07:28:31.179156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139848+0000","last_change":"2024-04-26T07:28:30.845233+0000","last_active":"2024-04-26T07:28:31.139848+0000","last_peered":"2024-04-26T07:28:31.139848+0000","last_clean":"2024-04-26T07:28:31.139848+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:28:31.139848+0000","last_undegraded":"2024-04-26T07:28:31.139848+0000","last_fullsized":"2024-04-26T07:28:31.139848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187631+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:31.187631+0000","last_peered":"2024-04-26T07:28:31.187631+0000","last_clean":"2024-04-26T07:28:31.187631+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:31.187631+0000","last_undegraded":"2024-04-26T07:28:31.187631+0000","last_fullsized":"2024-04-26T07:28:31.187631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137523+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:32.137523+0000","last_peered":"2024-04-26T07:28:32.137523+0000","last_clean":"2024-04-26T07:28:32.137523+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:32.137523+0000","last_undegraded":"2024-04-26T07:28:32.137523+0000","last_fullsized":"2024-04-26T07:28:32.137523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178874+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:31.178874+0000","last_peered":"2024-04-26T07:28:31.178874+0000","last_clean":"2024-04-26T07:28:31.178874+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:31.178874+0000","last_undegraded":"2024-04-26T07:28:31.178874+0000","last_fullsized":"2024-04-26T07:28:31.178874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848771+0000","last_change":"2024-04-26T07:28:30.850023+0000","last_active":"2024-04-26T07:28:33.848771+0000","last_peered":"2024-04-26T07:28:33.848771+0000","last_clean":"2024-04-26T07:28:33.848771+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:28:33.848771+0000","last_undegraded":"2024-04-26T07:28:33.848771+0000","last_fullsized":"2024-04-26T07:28:33.848771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172685+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:31.172685+0000","last_peered":"2024-04-26T07:28:31.172685+0000","last_clean":"2024-04-26T07:28:31.172685+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:31.172685+0000","last_undegraded":"2024-04-26T07:28:31.172685+0000","last_fullsized":"2024-04-26T07:28:31.172685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.844292+0000","last_change":"2024-04-26T07:28:30.853633+0000","last_active":"2024-04-26T07:28:33.844292+0000","last_peered":"2024-04-26T07:28:33.844292+0000","last_clean":"2024-04-26T07:28:33.844292+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:28:33.844292+0000","last_undegraded":"2024-04-26T07:28:33.844292+0000","last_fullsized":"2024-04-26T07:28:33.844292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178791+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:31.178791+0000","last_peered":"2024-04-26T07:28:31.178791+0000","last_clean":"2024-04-26T07:28:31.178791+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:31.178791+0000","last_undegraded":"2024-04-26T07:28:31.178791+0000","last_fullsized":"2024-04-26T07:28:31.178791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142866+0000","last_change":"2024-04-26T07:28:30.849815+0000","last_active":"2024-04-26T07:28:32.142866+0000","last_peered":"2024-04-26T07:28:32.142866+0000","last_clean":"2024-04-26T07:28:32.142866+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:28:32.142866+0000","last_undegraded":"2024-04-26T07:28:32.142866+0000","last_fullsized":"2024-04-26T07:28:32.142866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174574+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:31.174574+0000","last_peered":"2024-04-26T07:28:31.174574+0000","last_clean":"2024-04-26T07:28:31.174574+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:31.174574+0000","last_undegraded":"2024-04-26T07:28:31.174574+0000","last_fullsized":"2024-04-26T07:28:31.174574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.846821+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:28:33.846821+0000","last_peered":"2024-04-26T07:28:33.846821+0000","last_clean":"2024-04-26T07:28:33.846821+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:28:33.846821+0000","last_undegraded":"2024-04-26T07:28:33.846821+0000","last_fullsized":"2024-04-26T07:28:33.846821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172365+0000","last_change":"2024-04-26T07:28:31.165872+0000","last_active":"2024-04-26T07:28:31.172365+0000","last_peered":"2024-04-26T07:28:31.172365+0000","last_clean":"2024-04-26T07:28:31.172365+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:28:31.172365+0000","last_undegraded":"2024-04-26T07:28:31.172365+0000","last_fullsized":"2024-04-26T07:28:31.172365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849281+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:33.849281+0000","last_peered":"2024-04-26T07:28:33.849281+0000","last_clean":"2024-04-26T07:28:33.849281+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:33.849281+0000","last_undegraded":"2024-04-26T07:28:33.849281+0000","last_fullsized":"2024-04-26T07:28:33.849281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164229+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:31.164229+0000","last_peered":"2024-04-26T07:28:31.164229+0000","last_clean":"2024-04-26T07:28:31.164229+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:31.164229+0000","last_undegraded":"2024-04-26T07:28:31.164229+0000","last_fullsized":"2024-04-26T07:28:31.164229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848433+0000","last_change":"2024-04-26T07:28:30.847060+0000","last_active":"2024-04-26T07:28:33.848433+0000","last_peered":"2024-04-26T07:28:33.848433+0000","last_clean":"2024-04-26T07:28:33.848433+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:28:33.848433+0000","last_undegraded":"2024-04-26T07:28:33.848433+0000","last_fullsized":"2024-04-26T07:28:33.848433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179234+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:31.179234+0000","last_peered":"2024-04-26T07:28:31.179234+0000","last_clean":"2024-04-26T07:28:31.179234+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:31.179234+0000","last_undegraded":"2024-04-26T07:28:31.179234+0000","last_fullsized":"2024-04-26T07:28:31.179234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.137182+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:31.137182+0000","last_peered":"2024-04-26T07:28:31.137182+0000","last_clean":"2024-04-26T07:28:31.137182+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:31.137182+0000","last_undegraded":"2024-04-26T07:28:31.137182+0000","last_fullsized":"2024-04-26T07:28:31.137182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.183231+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:31.183231+0000","last_peered":"2024-04-26T07:28:31.183231+0000","last_clean":"2024-04-26T07:28:31.183231+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:31.183231+0000","last_undegraded":"2024-04-26T07:28:31.183231+0000","last_fullsized":"2024-04-26T07:28:31.183231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847615+0000","last_change":"2024-04-26T07:28:30.839424+0000","last_active":"2024-04-26T07:28:33.847615+0000","last_peered":"2024-04-26T07:28:33.847615+0000","last_clean":"2024-04-26T07:28:33.847615+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:28:33.847615+0000","last_undegraded":"2024-04-26T07:28:33.847615+0000","last_fullsized":"2024-04-26T07:28:33.847615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178885+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:31.178885+0000","last_peered":"2024-04-26T07:28:31.178885+0000","last_clean":"2024-04-26T07:28:31.178885+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:31.178885+0000","last_undegraded":"2024-04-26T07:28:31.178885+0000","last_fullsized":"2024-04-26T07:28:31.178885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187942+0000","last_change":"2024-04-26T07:28:30.849542+0000","last_active":"2024-04-26T07:28:31.187942+0000","last_peered":"2024-04-26T07:28:31.187942+0000","last_clean":"2024-04-26T07:28:31.187942+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:28:31.187942+0000","last_undegraded":"2024-04-26T07:28:31.187942+0000","last_fullsized":"2024-04-26T07:28:31.187942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172711+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:31.172711+0000","last_peered":"2024-04-26T07:28:31.172711+0000","last_clean":"2024-04-26T07:28:31.172711+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:31.172711+0000","last_undegraded":"2024-04-26T07:28:31.172711+0000","last_fullsized":"2024-04-26T07:28:31.172711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.176121+0000","last_change":"2024-04-26T07:28:30.853399+0000","last_active":"2024-04-26T07:28:31.176121+0000","last_peered":"2024-04-26T07:28:31.176121+0000","last_clean":"2024-04-26T07:28:31.176121+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:28:31.176121+0000","last_undegraded":"2024-04-26T07:28:31.176121+0000","last_fullsized":"2024-04-26T07:28:31.176121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163472+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:31.163472+0000","last_peered":"2024-04-26T07:28:31.163472+0000","last_clean":"2024-04-26T07:28:31.163472+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:31.163472+0000","last_undegraded":"2024-04-26T07:28:31.163472+0000","last_fullsized":"2024-04-26T07:28:31.163472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172956+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:31.172956+0000","last_peered":"2024-04-26T07:28:31.172956+0000","last_clean":"2024-04-26T07:28:31.172956+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:31.172956+0000","last_undegraded":"2024-04-26T07:28:31.172956+0000","last_fullsized":"2024-04-26T07:28:31.172956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171600+0000","last_change":"2024-04-26T07:28:31.165065+0000","last_active":"2024-04-26T07:28:31.171600+0000","last_peered":"2024-04-26T07:28:31.171600+0000","last_clean":"2024-04-26T07:28:31.171600+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:28:31.171600+0000","last_undegraded":"2024-04-26T07:28:31.171600+0000","last_fullsized":"2024-04-26T07:28:31.171600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146168+0000","last_change":"2024-04-26T07:28:30.844998+0000","last_active":"2024-04-26T07:28:31.146168+0000","last_peered":"2024-04-26T07:28:31.146168+0000","last_clean":"2024-04-26T07:28:31.146168+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:28:31.146168+0000","last_undegraded":"2024-04-26T07:28:31.146168+0000","last_fullsized":"2024-04-26T07:28:31.146168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186075+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:31.186075+0000","last_peered":"2024-04-26T07:28:31.186075+0000","last_clean":"2024-04-26T07:28:31.186075+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:31.186075+0000","last_undegraded":"2024-04-26T07:28:31.186075+0000","last_fullsized":"2024-04-26T07:28:31.186075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848965+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:33.848965+0000","last_peered":"2024-04-26T07:28:33.848965+0000","last_clean":"2024-04-26T07:28:33.848965+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:33.848965+0000","last_undegraded":"2024-04-26T07:28:33.848965+0000","last_fullsized":"2024-04-26T07:28:33.848965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.169765+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:31.169765+0000","last_peered":"2024-04-26T07:28:31.169765+0000","last_clean":"2024-04-26T07:28:31.169765+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:31.169765+0000","last_undegraded":"2024-04-26T07:28:31.169765+0000","last_fullsized":"2024-04-26T07:28:31.169765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139263+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:32.139263+0000","last_peered":"2024-04-26T07:28:32.139263+0000","last_clean":"2024-04-26T07:28:32.139263+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:32.139263+0000","last_undegraded":"2024-04-26T07:28:32.139263+0000","last_fullsized":"2024-04-26T07:28:32.139263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162684+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:31.162684+0000","last_peered":"2024-04-26T07:28:31.162684+0000","last_clean":"2024-04-26T07:28:31.162684+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:31.162684+0000","last_undegraded":"2024-04-26T07:28:31.162684+0000","last_fullsized":"2024-04-26T07:28:31.162684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848488+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:33.848488+0000","last_peered":"2024-04-26T07:28:33.848488+0000","last_clean":"2024-04-26T07:28:33.848488+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:33.848488+0000","last_undegraded":"2024-04-26T07:28:33.848488+0000","last_fullsized":"2024-04-26T07:28:33.848488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172151+0000","last_change":"2024-04-26T07:28:31.164112+0000","last_active":"2024-04-26T07:28:31.172151+0000","last_peered":"2024-04-26T07:28:31.172151+0000","last_clean":"2024-04-26T07:28:31.172151+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:28:31.172151+0000","last_undegraded":"2024-04-26T07:28:31.172151+0000","last_fullsized":"2024-04-26T07:28:31.172151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849342+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:33.849342+0000","last_peered":"2024-04-26T07:28:33.849342+0000","last_clean":"2024-04-26T07:28:33.849342+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:33.849342+0000","last_undegraded":"2024-04-26T07:28:33.849342+0000","last_fullsized":"2024-04-26T07:28:33.849342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.175642+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:31.175642+0000","last_peered":"2024-04-26T07:28:31.175642+0000","last_clean":"2024-04-26T07:28:31.175642+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:31.175642+0000","last_undegraded":"2024-04-26T07:28:31.175642+0000","last_fullsized":"2024-04-26T07:28:31.175642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.147037+0000","last_change":"2024-04-26T07:28:22.650334+0000","last_active":"2024-04-26T07:28:31.147037+0000","last_peered":"2024-04-26T07:28:31.147037+0000","last_clean":"2024-04-26T07:28:31.147037+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:28:31.147037+0000","last_undegraded":"2024-04-26T07:28:31.147037+0000","last_fullsized":"2024-04-26T07:28:31.147037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140042+0000","last_change":"2024-04-26T07:28:30.851175+0000","last_active":"2024-04-26T07:28:32.140042+0000","last_peered":"2024-04-26T07:28:32.140042+0000","last_clean":"2024-04-26T07:28:32.140042+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:28:32.140042+0000","last_undegraded":"2024-04-26T07:28:32.140042+0000","last_fullsized":"2024-04-26T07:28:32.140042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.174550+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:31.174550+0000","last_peered":"2024-04-26T07:28:31.174550+0000","last_clean":"2024-04-26T07:28:31.174550+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:31.174550+0000","last_undegraded":"2024-04-26T07:28:31.174550+0000","last_fullsized":"2024-04-26T07:28:31.174550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139938+0000","last_change":"2024-04-26T07:28:22.023450+0000","last_active":"2024-04-26T07:28:31.139938+0000","last_peered":"2024-04-26T07:28:31.139938+0000","last_clean":"2024-04-26T07:28:31.139938+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:28:31.139938+0000","last_undegraded":"2024-04-26T07:28:31.139938+0000","last_fullsized":"2024-04-26T07:28:31.139938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847520+0000","last_change":"2024-04-26T07:28:30.853616+0000","last_active":"2024-04-26T07:28:33.847520+0000","last_peered":"2024-04-26T07:28:33.847520+0000","last_clean":"2024-04-26T07:28:33.847520+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:28:33.847520+0000","last_undegraded":"2024-04-26T07:28:33.847520+0000","last_fullsized":"2024-04-26T07:28:33.847520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.163132+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:31.163132+0000","last_peered":"2024-04-26T07:28:31.163132+0000","last_clean":"2024-04-26T07:28:31.163132+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:31.163132+0000","last_undegraded":"2024-04-26T07:28:31.163132+0000","last_fullsized":"2024-04-26T07:28:31.163132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.146597+0000","last_change":"2024-04-26T07:28:22.024031+0000","last_active":"2024-04-26T07:28:31.146597+0000","last_peered":"2024-04-26T07:28:31.146597+0000","last_clean":"2024-04-26T07:28:31.146597+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:28:31.146597+0000","last_undegraded":"2024-04-26T07:28:31.146597+0000","last_fullsized":"2024-04-26T07:28:31.146597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138018+0000","last_change":"2024-04-26T07:28:30.839738+0000","last_active":"2024-04-26T07:28:32.138018+0000","last_peered":"2024-04-26T07:28:32.138018+0000","last_clean":"2024-04-26T07:28:32.138018+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:28:32.138018+0000","last_undegraded":"2024-04-26T07:28:32.138018+0000","last_fullsized":"2024-04-26T07:28:32.138018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186048+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:31.186048+0000","last_peered":"2024-04-26T07:28:31.186048+0000","last_clean":"2024-04-26T07:28:31.186048+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:31.186048+0000","last_undegraded":"2024-04-26T07:28:31.186048+0000","last_fullsized":"2024-04-26T07:28:31.186048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.139873+0000","last_change":"2024-04-26T07:28:22.023795+0000","last_active":"2024-04-26T07:28:31.139873+0000","last_peered":"2024-04-26T07:28:31.139873+0000","last_clean":"2024-04-26T07:28:31.139873+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:28:31.139873+0000","last_undegraded":"2024-04-26T07:28:31.139873+0000","last_fullsized":"2024-04-26T07:28:31.139873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140354+0000","last_change":"2024-04-26T07:28:18.549478+0000","last_active":"2024-04-26T07:28:31.140354+0000","last_peered":"2024-04-26T07:28:31.140354+0000","last_clean":"2024-04-26T07:28:31.140354+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:28:31.140354+0000","last_undegraded":"2024-04-26T07:28:31.140354+0000","last_fullsized":"2024-04-26T07:28:31.140354+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_clean_scrub_stamp":"2024-04-26T07:28:14.971410+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.135798+0000","last_change":"2024-04-26T07:28:30.859261+0000","last_active":"2024-04-26T07:28:31.135798+0000","last_peered":"2024-04-26T07:28:31.135798+0000","last_clean":"2024-04-26T07:28:31.135798+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:28:31.135798+0000","last_undegraded":"2024-04-26T07:28:31.135798+0000","last_fullsized":"2024-04-26T07:28:31.135798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.179112+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:31.179112+0000","last_peered":"2024-04-26T07:28:31.179112+0000","last_clean":"2024-04-26T07:28:31.179112+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:31.179112+0000","last_undegraded":"2024-04-26T07:28:31.179112+0000","last_fullsized":"2024-04-26T07:28:31.179112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.136584+0000","last_change":"2024-04-26T07:28:22.026306+0000","last_active":"2024-04-26T07:28:31.136584+0000","last_peered":"2024-04-26T07:28:31.136584+0000","last_clean":"2024-04-26T07:28:31.136584+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:28:31.136584+0000","last_undegraded":"2024-04-26T07:28:31.136584+0000","last_fullsized":"2024-04-26T07:28:31.136584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142616+0000","last_change":"2024-04-26T07:28:30.854930+0000","last_active":"2024-04-26T07:28:32.142616+0000","last_peered":"2024-04-26T07:28:32.142616+0000","last_clean":"2024-04-26T07:28:32.142616+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:28:32.142616+0000","last_undegraded":"2024-04-26T07:28:32.142616+0000","last_fullsized":"2024-04-26T07:28:32.142616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.186614+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:31.186614+0000","last_peered":"2024-04-26T07:28:31.186614+0000","last_clean":"2024-04-26T07:28:31.186614+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:31.186614+0000","last_undegraded":"2024-04-26T07:28:31.186614+0000","last_fullsized":"2024-04-26T07:28:31.186614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.149451+0000","last_change":"2024-04-26T07:28:22.650352+0000","last_active":"2024-04-26T07:28:31.149451+0000","last_peered":"2024-04-26T07:28:31.149451+0000","last_clean":"2024-04-26T07:28:31.149451+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:28:31.149451+0000","last_undegraded":"2024-04-26T07:28:31.149451+0000","last_fullsized":"2024-04-26T07:28:31.149451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140458+0000","last_change":"2024-04-26T07:28:30.844050+0000","last_active":"2024-04-26T07:28:31.140458+0000","last_peered":"2024-04-26T07:28:31.140458+0000","last_clean":"2024-04-26T07:28:31.140458+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:28:31.140458+0000","last_undegraded":"2024-04-26T07:28:31.140458+0000","last_fullsized":"2024-04-26T07:28:31.140458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.180827+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:31.180827+0000","last_peered":"2024-04-26T07:28:31.180827+0000","last_clean":"2024-04-26T07:28:31.180827+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:31.180827+0000","last_undegraded":"2024-04-26T07:28:31.180827+0000","last_fullsized":"2024-04-26T07:28:31.180827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847920+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:33.847920+0000","last_peered":"2024-04-26T07:28:33.847920+0000","last_clean":"2024-04-26T07:28:33.847920+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:33.847920+0000","last_undegraded":"2024-04-26T07:28:33.847920+0000","last_fullsized":"2024-04-26T07:28:33.847920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.140850+0000","last_change":"2024-04-26T07:28:22.650310+0000","last_active":"2024-04-26T07:28:31.140850+0000","last_peered":"2024-04-26T07:28:31.140850+0000","last_clean":"2024-04-26T07:28:31.140850+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:28:31.140850+0000","last_undegraded":"2024-04-26T07:28:31.140850+0000","last_fullsized":"2024-04-26T07:28:31.140850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172737+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:31.172737+0000","last_peered":"2024-04-26T07:28:31.172737+0000","last_clean":"2024-04-26T07:28:31.172737+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:31.172737+0000","last_undegraded":"2024-04-26T07:28:31.172737+0000","last_fullsized":"2024-04-26T07:28:31.172737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.142937+0000","last_change":"2024-04-26T07:28:22.650378+0000","last_active":"2024-04-26T07:28:31.142937+0000","last_peered":"2024-04-26T07:28:31.142937+0000","last_clean":"2024-04-26T07:28:31.142937+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:28:31.142937+0000","last_undegraded":"2024-04-26T07:28:31.142937+0000","last_fullsized":"2024-04-26T07:28:31.142937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142805+0000","last_change":"2024-04-26T07:28:30.848849+0000","last_active":"2024-04-26T07:28:32.142805+0000","last_peered":"2024-04-26T07:28:32.142805+0000","last_clean":"2024-04-26T07:28:32.142805+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:28:32.142805+0000","last_undegraded":"2024-04-26T07:28:32.142805+0000","last_fullsized":"2024-04-26T07:28:32.142805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172185+0000","last_change":"2024-04-26T07:28:31.160967+0000","last_active":"2024-04-26T07:28:31.172185+0000","last_peered":"2024-04-26T07:28:31.172185+0000","last_clean":"2024-04-26T07:28:31.172185+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:28:31.172185+0000","last_undegraded":"2024-04-26T07:28:31.172185+0000","last_fullsized":"2024-04-26T07:28:31.172185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849877+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:33.849877+0000","last_peered":"2024-04-26T07:28:33.849877+0000","last_clean":"2024-04-26T07:28:33.849877+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:33.849877+0000","last_undegraded":"2024-04-26T07:28:33.849877+0000","last_fullsized":"2024-04-26T07:28:33.849877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.161796+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:31.161796+0000","last_peered":"2024-04-26T07:28:31.161796+0000","last_clean":"2024-04-26T07:28:31.161796+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:31.161796+0000","last_undegraded":"2024-04-26T07:28:31.161796+0000","last_fullsized":"2024-04-26T07:28:31.161796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.178894+0000","last_change":"2024-04-26T07:28:30.852699+0000","last_active":"2024-04-26T07:28:31.178894+0000","last_peered":"2024-04-26T07:28:31.178894+0000","last_clean":"2024-04-26T07:28:31.178894+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:28:31.178894+0000","last_undegraded":"2024-04-26T07:28:31.178894+0000","last_fullsized":"2024-04-26T07:28:31.178894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.172388+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:31.172388+0000","last_peered":"2024-04-26T07:28:31.172388+0000","last_clean":"2024-04-26T07:28:31.172388+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:31.172388+0000","last_undegraded":"2024-04-26T07:28:31.172388+0000","last_fullsized":"2024-04-26T07:28:31.172388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.177540+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:31.177540+0000","last_peered":"2024-04-26T07:28:31.177540+0000","last_clean":"2024-04-26T07:28:31.177540+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:31.177540+0000","last_undegraded":"2024-04-26T07:28:31.177540+0000","last_fullsized":"2024-04-26T07:28:31.177540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171622+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:31.171622+0000","last_peered":"2024-04-26T07:28:31.171622+0000","last_clean":"2024-04-26T07:28:31.171622+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:31.171622+0000","last_undegraded":"2024-04-26T07:28:31.171622+0000","last_fullsized":"2024-04-26T07:28:31.171622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.156602+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:31.156602+0000","last_peered":"2024-04-26T07:28:31.156602+0000","last_clean":"2024-04-26T07:28:31.156602+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:31.156602+0000","last_undegraded":"2024-04-26T07:28:31.156602+0000","last_fullsized":"2024-04-26T07:28:31.156602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162955+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:31.162955+0000","last_peered":"2024-04-26T07:28:31.162955+0000","last_clean":"2024-04-26T07:28:31.162955+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:31.162955+0000","last_undegraded":"2024-04-26T07:28:31.162955+0000","last_fullsized":"2024-04-26T07:28:31.162955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.187941+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:31.187941+0000","last_peered":"2024-04-26T07:28:31.187941+0000","last_clean":"2024-04-26T07:28:31.187941+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:31.187941+0000","last_undegraded":"2024-04-26T07:28:31.187941+0000","last_fullsized":"2024-04-26T07:28:31.187941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.171434+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:31.171434+0000","last_peered":"2024-04-26T07:28:31.171434+0000","last_clean":"2024-04-26T07:28:31.171434+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:31.171434+0000","last_undegraded":"2024-04-26T07:28:31.171434+0000","last_fullsized":"2024-04-26T07:28:31.171434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.166241+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:31.166241+0000","last_peered":"2024-04-26T07:28:31.166241+0000","last_clean":"2024-04-26T07:28:31.166241+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:31.166241+0000","last_undegraded":"2024-04-26T07:28:31.166241+0000","last_fullsized":"2024-04-26T07:28:31.166241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.162933+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:31.162933+0000","last_peered":"2024-04-26T07:28:31.162933+0000","last_clean":"2024-04-26T07:28:31.162933+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:31.162933+0000","last_undegraded":"2024-04-26T07:28:31.162933+0000","last_fullsized":"2024-04-26T07:28:31.162933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.169782+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:31.169782+0000","last_peered":"2024-04-26T07:28:31.169782+0000","last_clean":"2024-04-26T07:28:31.169782+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:31.169782+0000","last_undegraded":"2024-04-26T07:28:31.169782+0000","last_fullsized":"2024-04-26T07:28:31.169782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.164315+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:31.164315+0000","last_peered":"2024-04-26T07:28:31.164315+0000","last_clean":"2024-04-26T07:28:31.164315+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:31.164315+0000","last_undegraded":"2024-04-26T07:28:31.164315+0000","last_fullsized":"2024-04-26T07:28:31.164315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T07:28:31.173981+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:31.173981+0000","last_peered":"2024-04-26T07:28:31.173981+0000","last_clean":"2024-04-26T07:28:31.173981+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:31.173981+0000","last_undegraded":"2024-04-26T07:28:31.173981+0000","last_fullsized":"2024-04-26T07:28:31.173981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":52764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.193}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]}]}]}} 2024-04-26T07:28:40.479 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T07:28:40.479 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T07:28:40.479 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T07:28:40.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T07:28:40.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.620+0000 7fa41c1e5700 1 Processor -- start 2024-04-26T07:28:40.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.620+0000 7fa41c1e5700 1 -- start start 2024-04-26T07:28:40.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41c1e5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa414136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41c1e5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41c1e5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41406cd70 con 0x7fa41406c990 2024-04-26T07:28:40.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41c1e5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa414137340 con 0x7fa414133340 2024-04-26T07:28:40.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41c1e5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa414132eb0 con 0x7fa4140648b0 2024-04-26T07:28:40.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41a782700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa419780700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa414136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41a782700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44066/0 (socket says 172.21.15.31:44066) 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa419f81700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa41406c990 0x7fa414136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60994/0 (socket says 172.21.15.31:60994) 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41a782700 1 -- 172.21.15.31:0/3921756598 learned_addr learned my addr 172.21.15.31:0/3921756598 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa419780700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa414136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34818/0 (socket says 172.21.15.31:34818) 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41a782700 1 -- 172.21.15.31:0/3921756598 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 msgr2=0x7fa414136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41a782700 1 --2- 172.21.15.31:0/3921756598 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa414136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa418f7f700 1 -- 172.21.15.31:0/3921756598 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768406870 0 0) 0x7fa41406cd70 con 0x7fa41406c990 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41a782700 1 -- 172.21.15.31:0/3921756598 >> v1:172.21.15.31:6789/0 conn(0x7fa41406c990 legacy=0x7fa414136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41a782700 1 -- 172.21.15.31:0/3921756598 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa414063c00 con 0x7fa414133340 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa419780700 1 --2- 172.21.15.31:0/3921756598 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa414136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa41a782700 1 --2- 172.21.15.31:0/3921756598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141337d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa414064330 tx=0x7fa40c009290).ready entity=mon.1 client_cookie=6cf86da51fecd8b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:40.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa418f7f700 1 -- 172.21.15.31:0/3921756598 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40c00b860 con 0x7fa414133340 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa418f7f700 1 -- 172.21.15.31:0/3921756598 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c00b9c0 con 0x7fa414133340 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.621+0000 7fa418f7f700 1 -- 172.21.15.31:0/3921756598 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40c00bb80 con 0x7fa414133340 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.622+0000 7fa41c1e5700 1 -- 172.21.15.31:0/3921756598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 msgr2=0x7fa4141337d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.622+0000 7fa41c1e5700 1 --2- 172.21.15.31:0/3921756598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141337d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa414064330 tx=0x7fa40c009290).stop 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.622+0000 7fa41c1e5700 1 -- 172.21.15.31:0/3921756598 shutdown_connections 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.622+0000 7fa41c1e5700 1 --2- 172.21.15.31:0/3921756598 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141337d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.622+0000 7fa41c1e5700 1 --2- 172.21.15.31:0/3921756598 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa414136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.622+0000 7fa41c1e5700 1 -- 172.21.15.31:0/3921756598 >> 172.21.15.31:0/3921756598 conn(0x7fa414061370 msgr2=0x7fa41406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.622+0000 7fa41c1e5700 1 -- 172.21.15.31:0/3921756598 shutdown_connections 2024-04-26T07:28:40.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.622+0000 7fa41c1e5700 1 -- 172.21.15.31:0/3921756598 wait complete. 2024-04-26T07:28:40.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa41c1e5700 1 Processor -- start 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa41c1e5700 1 -- start start 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa41c1e5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa41413c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa41c1e5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41406c990 0x7fa4141471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa41c1e5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa41c1e5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41413a7d0 con 0x7fa41406c990 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa41c1e5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41413a420 con 0x7fa414133340 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa41c1e5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa41413a5e0 con 0x7fa4140648b0 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.623+0000 7fa419f81700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa41413c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa41a782700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419f81700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa41413c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34826/0 (socket says 172.21.15.31:34826) 2024-04-26T07:28:40.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa41a782700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44070/0 (socket says 172.21.15.31:44070) 2024-04-26T07:28:40.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419f81700 1 -- 172.21.15.31:0/1005468107 learned_addr learned my addr 172.21.15.31:0/1005468107 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:40.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419780700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41406c990 0x7fa4141471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419f81700 1 -- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 msgr2=0x7fa4141479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419f81700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419f81700 1 -- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41406c990 msgr2=0x7fa4141471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419f81700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41406c990 0x7fa4141471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419f81700 1 -- 172.21.15.31:0/1005468107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40400b180 con 0x7fa4140648b0 2024-04-26T07:28:40.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419780700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41406c990 0x7fa4141471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T07:28:40.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa41a782700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa419f81700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa41413c330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa410000bc0 tx=0x7fa410007a60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:40.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa402ffd700 1 -- 172.21.15.31:0/1005468107 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4100070d0 con 0x7fa4140648b0 2024-04-26T07:28:40.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa402ffd700 1 -- 172.21.15.31:0/1005468107 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa410007230 con 0x7fa4140648b0 2024-04-26T07:28:40.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c009530 con 0x7fa4140648b0 2024-04-26T07:28:40.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa402ffd700 1 -- 172.21.15.31:0/1005468107 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa410005740 con 0x7fa4140648b0 2024-04-26T07:28:40.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.624+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa414091f10 con 0x7fa4140648b0 2024-04-26T07:28:40.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.625+0000 7fa402ffd700 1 -- 172.21.15.31:0/1005468107 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa410010070 con 0x7fa4140648b0 2024-04-26T07:28:40.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.625+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa414133cc0 con 0x7fa4140648b0 2024-04-26T07:28:40.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.625+0000 7fa402ffd700 1 -- 172.21.15.31:0/1005468107 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa410049f00 con 0x7fa4140648b0 2024-04-26T07:28:40.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.628+0000 7fa402ffd700 1 -- 172.21.15.31:0/1005468107 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa41002ee00 con 0x7fa4140648b0 2024-04-26T07:28:40.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.783+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa414064dd0 con 0x7fa4140648b0 2024-04-26T07:28:40.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.783+0000 7fa402ffd700 1 -- 172.21.15.31:0/1005468107 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fa410032420 con 0x7fa4140648b0 2024-04-26T07:28:40.784 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:40.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 >> v1:172.21.15.31:6816/39613 conn(0x7fa3f4038f50 legacy=0x7fa3f403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 msgr2=0x7fa41413c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa41413c330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa410000bc0 tx=0x7fa410007a60).stop 2024-04-26T07:28:40.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 shutdown_connections 2024-04-26T07:28:40.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa4140648b0 0x7fa41413c330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa414133340 0x7fa4141479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 --2- 172.21.15.31:0/1005468107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41406c990 0x7fa4141471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 >> 172.21.15.31:0/1005468107 conn(0x7fa414061370 msgr2=0x7fa41413cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:40.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 shutdown_connections 2024-04-26T07:28:40.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.785+0000 7fa41c1e5700 1 -- 172.21.15.31:0/1005468107 wait complete. 2024-04-26T07:28:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T07:28:40.796 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T07:28:40.796 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.904+0000 7fdbe99f9700 1 Processor -- start 2024-04-26T07:28:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.904+0000 7fdbe99f9700 1 -- start start 2024-04-26T07:28:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe99f9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdbe4067500 0x7fdbe409a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe99f9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409c0a0 0x7fdbe4136d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe99f9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe409b670 con 0x7fdbe409bc70 2024-04-26T07:28:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe99f9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe41361b0 con 0x7fdbe4067500 2024-04-26T07:28:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe99f9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe409b400 con 0x7fdbe409c0a0 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdbe4067500 0x7fdbe409a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409c0a0 0x7fdbe4136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdbe4067500 0x7fdbe409a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42214/0 (socket says 172.21.15.31:42214) 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409c0a0 0x7fdbe4136d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34828/0 (socket says 172.21.15.31:34828) 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe2ffd700 1 -- 172.21.15.31:0/2968223150 learned_addr learned my addr 172.21.15.31:0/2968223150 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe37fe700 1 -- 172.21.15.31:0/2968223150 >> v2:172.21.15.31:3300/0 conn(0x7fdbe4067500 msgr2=0x7fdbe409a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe37fe700 1 --2- 172.21.15.31:0/2968223150 >> v2:172.21.15.31:3300/0 conn(0x7fdbe4067500 0x7fdbe409a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe37fe700 1 -- 172.21.15.31:0/2968223150 >> v1:172.21.15.31:6789/0 conn(0x7fdbe409bc70 legacy=0x7fdbe4136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe37fe700 1 -- 172.21.15.31:0/2968223150 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe41363a0 con 0x7fdbe409c0a0 2024-04-26T07:28:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe1ffb700 1 -- 172.21.15.31:0/2968223150 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431378384 0 0) 0x7fdbe409b670 con 0x7fdbe409bc70 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe2ffd700 1 --2- 172.21.15.31:0/2968223150 >> v2:172.21.15.31:3300/0 conn(0x7fdbe4067500 0x7fdbe409a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe37fe700 1 --2- 172.21.15.31:0/2968223150 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409c0a0 0x7fdbe4136d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdbdc0032f0 tx=0x7fdbdc0091d0).ready entity=mon.2 client_cookie=7919fbfbcd768f4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe1ffb700 1 -- 172.21.15.31:0/2968223150 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbdc00b6c0 con 0x7fdbe409c0a0 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.905+0000 7fdbe1ffb700 1 -- 172.21.15.31:0/2968223150 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00b820 con 0x7fdbe409c0a0 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe1ffb700 1 -- 172.21.15.31:0/2968223150 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbdc00b990 con 0x7fdbe409c0a0 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe99f9700 1 -- 172.21.15.31:0/2968223150 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409c0a0 msgr2=0x7fdbe4136d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe99f9700 1 --2- 172.21.15.31:0/2968223150 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409c0a0 0x7fdbe4136d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdbdc0032f0 tx=0x7fdbdc0091d0).stop 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe99f9700 1 -- 172.21.15.31:0/2968223150 shutdown_connections 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe99f9700 1 --2- 172.21.15.31:0/2968223150 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409c0a0 0x7fdbe4136d70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe99f9700 1 --2- 172.21.15.31:0/2968223150 >> v2:172.21.15.31:3300/0 conn(0x7fdbe4067500 0x7fdbe409a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe99f9700 1 -- 172.21.15.31:0/2968223150 >> 172.21.15.31:0/2968223150 conn(0x7fdbe405cfb0 msgr2=0x7fdbe4062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe99f9700 1 -- 172.21.15.31:0/2968223150 shutdown_connections 2024-04-26T07:28:40.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.906+0000 7fdbe99f9700 1 -- 172.21.15.31:0/2968223150 wait complete. 2024-04-26T07:28:40.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.907+0000 7fdbe99f9700 1 Processor -- start 2024-04-26T07:28:40.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.907+0000 7fdbe99f9700 1 -- start start 2024-04-26T07:28:40.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe99f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbe4067500 0x7fdbe4134450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe99f9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409bc70 0x7fdbe4094ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe99f9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbe409c0a0 0x7fdbe41459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe99f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe4094620 con 0x7fdbe4067500 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe99f9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe4145730 con 0x7fdbe409c0a0 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe99f9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe4134e30 con 0x7fdbe409bc70 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe27fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409bc70 0x7fdbe4094ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe27fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409bc70 0x7fdbe4094ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34842/0 (socket says 172.21.15.31:34842) 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbe4067500 0x7fdbe4134450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe27fc700 1 -- 172.21.15.31:0/4120969828 learned_addr learned my addr 172.21.15.31:0/4120969828 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe37fe700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbe409c0a0 0x7fdbe41459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe2ffd700 1 -- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409bc70 msgr2=0x7fdbe4094ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe2ffd700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409bc70 0x7fdbe4094ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe2ffd700 1 -- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbe409c0a0 msgr2=0x7fdbe41459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe2ffd700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbe409c0a0 0x7fdbe41459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe2ffd700 1 -- 172.21.15.31:0/4120969828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd800b1e0 con 0x7fdbe4067500 2024-04-26T07:28:40.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe27fc700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409bc70 0x7fdbe4094ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe37fe700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbe409c0a0 0x7fdbe41459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe2ffd700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbe4067500 0x7fdbe4134450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fdbd800c000 tx=0x7fdbd8006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbd3fff700 1 -- 172.21.15.31:0/4120969828 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd8012600 con 0x7fdbe4067500 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbd3fff700 1 -- 172.21.15.31:0/4120969828 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8012760 con 0x7fdbe4067500 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc009470 con 0x7fdbe4067500 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbd3fff700 1 -- 172.21.15.31:0/4120969828 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd8012ac0 con 0x7fdbe4067500 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.908+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe4094fa0 con 0x7fdbe4067500 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.909+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe4095250 con 0x7fdbe4067500 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.909+0000 7fdbd3fff700 1 -- 172.21.15.31:0/4120969828 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdbd8022070 con 0x7fdbe4067500 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.910+0000 7fdbd3fff700 1 -- 172.21.15.31:0/4120969828 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdbd804abd0 con 0x7fdbe4067500 2024-04-26T07:28:40.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:40.912+0000 7fdbd3fff700 1 -- 172.21.15.31:0/4120969828 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdbd8033500 con 0x7fdbe4067500 2024-04-26T07:28:41.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.029+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbe4067960 con 0x7fdbe4067500 2024-04-26T07:28:41.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.030+0000 7fdbd3fff700 1 -- 172.21.15.31:0/4120969828 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7fdbd80330f0 con 0x7fdbe4067500 2024-04-26T07:28:41.030 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:41.031 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:32.133218+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 >> v1:172.21.15.31:6816/39613 conn(0x7fdbc0038dd0 legacy=0x7fdbc003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbe4067500 msgr2=0x7fdbe4134450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbe4067500 0x7fdbe4134450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fdbd800c000 tx=0x7fdbd8006eb0).stop 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 shutdown_connections 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbe409c0a0 0x7fdbe41459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbe4067500 0x7fdbe4134450 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 --2- 172.21.15.31:0/4120969828 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdbe409bc70 0x7fdbe4094ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 >> 172.21.15.31:0/4120969828 conn(0x7fdbe405cfb0 msgr2=0x7fdbe413b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 shutdown_connections 2024-04-26T07:28:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.031+0000 7fdbe99f9700 1 -- 172.21.15.31:0/4120969828 wait complete. 2024-04-26T07:28:41.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T07:28:28.939656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T07:28:30.129744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T07:28:41.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:28:41.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.152+0000 7f1c6d0fa700 1 Processor -- start 2024-04-26T07:28:41.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.152+0000 7f1c6d0fa700 1 -- start start 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6d0fa700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c680648b0 0x7f1c68136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6d0fa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c68133340 0x7f1c681337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6d0fa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6806cd70 con 0x7f1c6806c990 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6d0fa700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c68137340 con 0x7f1c68133340 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6d0fa700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68132eb0 con 0x7f1c680648b0 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c68133340 0x7f1c681337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c680648b0 0x7f1c68136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c68133340 0x7f1c681337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42236/0 (socket says 172.21.15.31:42236) 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c680648b0 0x7f1c68136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34852/0 (socket says 172.21.15.31:34852) 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c66d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1c6806c990 0x7f1c68136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32790/0 (socket says 172.21.15.31:32790) 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6759e700 1 -- 172.21.15.31:0/2765844634 learned_addr learned my addr 172.21.15.31:0/2765844634 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:41.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6759e700 1 -- 172.21.15.31:0/2765844634 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c680648b0 msgr2=0x7f1c68136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6759e700 1 --2- 172.21.15.31:0/2765844634 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c680648b0 0x7f1c68136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c6759e700 1 -- 172.21.15.31:0/2765844634 >> v1:172.21.15.31:6789/0 conn(0x7f1c6806c990 legacy=0x7f1c68136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.153+0000 7f1c65d9b700 1 -- 172.21.15.31:0/2765844634 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715717998 0 0) 0x7f1c6806cd70 con 0x7f1c6806c990 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6759e700 1 -- 172.21.15.31:0/2765844634 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68063c00 con 0x7f1c68133340 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6659c700 1 --2- 172.21.15.31:0/2765844634 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c680648b0 0x7f1c68136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6759e700 1 --2- 172.21.15.31:0/2765844634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c68133340 0x7f1c681337a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1c600032f0 tx=0x7f1c6000b530).ready entity=mon.0 client_cookie=aaa972140a5df207 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c65d9b700 1 -- 172.21.15.31:0/2765844634 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c6000de20 con 0x7f1c68133340 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c65d9b700 1 -- 172.21.15.31:0/2765844634 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c60010470 con 0x7f1c68133340 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c65d9b700 1 -- 172.21.15.31:0/2765844634 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c600107d0 con 0x7f1c68133340 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/2765844634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c68133340 msgr2=0x7f1c681337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6d0fa700 1 --2- 172.21.15.31:0/2765844634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c68133340 0x7f1c681337a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1c600032f0 tx=0x7f1c6000b530).stop 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/2765844634 shutdown_connections 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6d0fa700 1 --2- 172.21.15.31:0/2765844634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c68133340 0x7f1c681337a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6d0fa700 1 --2- 172.21.15.31:0/2765844634 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c680648b0 0x7f1c68136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/2765844634 >> 172.21.15.31:0/2765844634 conn(0x7f1c68061370 msgr2=0x7f1c6806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:41.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/2765844634 shutdown_connections 2024-04-26T07:28:41.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.154+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/2765844634 wait complete. 2024-04-26T07:28:41.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.155+0000 7f1c6d0fa700 1 Processor -- start 2024-04-26T07:28:41.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.155+0000 7f1c6d0fa700 1 -- start start 2024-04-26T07:28:41.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6d0fa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c680648b0 0x7f1c68094470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6d0fa700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c6806c990 0x7f1c681448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6d0fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c68133340 0x7f1c68144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6d0fa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680934e0 con 0x7f1c680648b0 2024-04-26T07:28:41.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6d0fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68095890 con 0x7f1c68133340 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6d0fa700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68095b30 con 0x7f1c6806c990 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c66d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c680648b0 0x7f1c68094470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c66d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c680648b0 0x7f1c68094470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42240/0 (socket says 172.21.15.31:42240) 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c66d9d700 1 -- 172.21.15.31:0/3228344834 learned_addr learned my addr 172.21.15.31:0/3228344834 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6659c700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c6806c990 0x7f1c681448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6759e700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c68133340 0x7f1c68144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c66d9d700 1 -- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c6806c990 msgr2=0x7f1c681448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c66d9d700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c6806c990 0x7f1c681448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c66d9d700 1 -- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c68133340 msgr2=0x7f1c68144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c66d9d700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c68133340 0x7f1c68144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c66d9d700 1 -- 172.21.15.31:0/3228344834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5800b180 con 0x7f1c680648b0 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.156+0000 7f1c6659c700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c6806c990 0x7f1c681448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.157+0000 7f1c66d9d700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c680648b0 0x7f1c68094470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1c5c000bc0 tx=0x7f1c5c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.157+0000 7f1c57fff700 1 -- 172.21.15.31:0/3228344834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c5c0070d0 con 0x7f1c680648b0 2024-04-26T07:28:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.157+0000 7f1c57fff700 1 -- 172.21.15.31:0/3228344834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c007230 con 0x7f1c680648b0 2024-04-26T07:28:41.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.157+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6000b7d0 con 0x7f1c680648b0 2024-04-26T07:28:41.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.157+0000 7f1c57fff700 1 -- 172.21.15.31:0/3228344834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c5c005740 con 0x7f1c680648b0 2024-04-26T07:28:41.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.157+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68094960 con 0x7f1c680648b0 2024-04-26T07:28:41.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.158+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6806bbc0 con 0x7f1c680648b0 2024-04-26T07:28:41.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.158+0000 7f1c57fff700 1 -- 172.21.15.31:0/3228344834 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1c5c01a060 con 0x7f1c680648b0 2024-04-26T07:28:41.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.158+0000 7f1c57fff700 1 -- 172.21.15.31:0/3228344834 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1c5c049be0 con 0x7f1c680648b0 2024-04-26T07:28:41.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.161+0000 7f1c57fff700 1 -- 172.21.15.31:0/3228344834 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1c5c02eae0 con 0x7f1c680648b0 2024-04-26T07:28:41.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.278+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1c680a9ec0 con 0x7f1c680648b0 2024-04-26T07:28:41.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.279+0000 7f1c57fff700 1 -- 172.21.15.31:0/3228344834 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1c5c018030 con 0x7f1c680648b0 2024-04-26T07:28:41.279 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 >> v1:172.21.15.31:6816/39613 conn(0x7f1c44038f50 legacy=0x7f1c4403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c680648b0 msgr2=0x7f1c68094470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c680648b0 0x7f1c68094470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1c5c000bc0 tx=0x7f1c5c007a60).stop 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 shutdown_connections 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c68133340 0x7f1c68144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c680648b0 0x7f1c68094470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 --2- 172.21.15.31:0/3228344834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c6806c990 0x7f1c681448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 >> 172.21.15.31:0/3228344834 conn(0x7f1c68061370 msgr2=0x7f1c68062800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 shutdown_connections 2024-04-26T07:28:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.280+0000 7f1c6d0fa700 1 -- 172.21.15.31:0/3228344834 wait complete. 2024-04-26T07:28:41.291 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:28:41.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.400+0000 7fb6ba7ca700 1 Processor -- start 2024-04-26T07:28:41.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.400+0000 7fb6ba7ca700 1 -- start start 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.400+0000 7fb6ba7ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b4067500 0x7fb6b409a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.400+0000 7fb6ba7ca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b409bc70 0x7fb6b4136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.400+0000 7fb6ba7ca700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b409b670 con 0x7fb6b409c070 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.400+0000 7fb6ba7ca700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b41361b0 con 0x7fb6b409bc70 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.400+0000 7fb6ba7ca700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b409b400 con 0x7fb6b4067500 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b409bc70 0x7fb6b4136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b4067500 0x7fb6b409a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b4067500 0x7fb6b409a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44094/0 (socket says 172.21.15.31:44094) 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b409bc70 0x7fb6b4136660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42252/0 (socket says 172.21.15.31:42252) 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b3fff700 1 -- 172.21.15.31:0/4187021286 learned_addr learned my addr 172.21.15.31:0/4187021286 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b8d67700 1 --1- 172.21.15.31:0/4187021286 >> v1:172.21.15.31:6789/0 conn(0x7fb6b409c070 0x7fb6b4136b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32806/0 (socket says 172.21.15.31:32806) 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b37fe700 1 -- 172.21.15.31:0/4187021286 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b4067500 msgr2=0x7fb6b409a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:41.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b37fe700 1 --2- 172.21.15.31:0/4187021286 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b4067500 0x7fb6b409a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b37fe700 1 -- 172.21.15.31:0/4187021286 >> v1:172.21.15.31:6789/0 conn(0x7fb6b409c070 legacy=0x7fb6b4136b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b2ffd700 1 -- 172.21.15.31:0/4187021286 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269490264 0 0) 0x7fb6b409b670 con 0x7fb6b409c070 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b37fe700 1 -- 172.21.15.31:0/4187021286 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b41363a0 con 0x7fb6b409bc70 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b3fff700 1 --2- 172.21.15.31:0/4187021286 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b4067500 0x7fb6b409a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b37fe700 1 --2- 172.21.15.31:0/4187021286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b409bc70 0x7fb6b4136660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb6a8002f70 tx=0x7fb6a8006df0).ready entity=mon.0 client_cookie=e35aba0b25712386 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b2ffd700 1 -- 172.21.15.31:0/4187021286 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a800d570 con 0x7fb6b409bc70 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b2ffd700 1 -- 172.21.15.31:0/4187021286 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a8000e90 con 0x7fb6b409bc70 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.401+0000 7fb6b2ffd700 1 -- 172.21.15.31:0/4187021286 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a800d8c0 con 0x7fb6b409bc70 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.402+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/4187021286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b409bc70 msgr2=0x7fb6b4136660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.402+0000 7fb6ba7ca700 1 --2- 172.21.15.31:0/4187021286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b409bc70 0x7fb6b4136660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb6a8002f70 tx=0x7fb6a8006df0).stop 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.402+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/4187021286 shutdown_connections 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.402+0000 7fb6ba7ca700 1 --2- 172.21.15.31:0/4187021286 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b4067500 0x7fb6b409a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.402+0000 7fb6ba7ca700 1 --2- 172.21.15.31:0/4187021286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b409bc70 0x7fb6b4136660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.402+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/4187021286 >> 172.21.15.31:0/4187021286 conn(0x7fb6b405cfb0 msgr2=0x7fb6b4062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:41.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.402+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/4187021286 shutdown_connections 2024-04-26T07:28:41.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.402+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/4187021286 wait complete. 2024-04-26T07:28:41.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.403+0000 7fb6ba7ca700 1 Processor -- start 2024-04-26T07:28:41.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.403+0000 7fb6ba7ca700 1 -- start start 2024-04-26T07:28:41.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6ba7ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b4067500 0x7fb6b4095190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6ba7ca700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b409bc70 0x7fb6b41490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6ba7ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b409c070 0x7fb6b41495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6ba7ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b40958e0 con 0x7fb6b4067500 2024-04-26T07:28:41.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6ba7ca700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b4095680 con 0x7fb6b409c070 2024-04-26T07:28:41.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6ba7ca700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b4138930 con 0x7fb6b409bc70 2024-04-26T07:28:41.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b4067500 0x7fb6b4095190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b4067500 0x7fb6b4095190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42258/0 (socket says 172.21.15.31:42258) 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 -- 172.21.15.31:0/1098250057 learned_addr learned my addr 172.21.15.31:0/1098250057 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b37fe700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b409bc70 0x7fb6b41490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b8d67700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b409c070 0x7fb6b41495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 -- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b409bc70 msgr2=0x7fb6b41490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b409bc70 0x7fb6b41490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 -- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b409c070 msgr2=0x7fb6b41495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b409c070 0x7fb6b41495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 -- 172.21.15.31:0/1098250057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a400b1e0 con 0x7fb6b4067500 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b8d67700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b409c070 0x7fb6b41495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b3fff700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b4067500 0x7fb6b4095190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb6a400c000 tx=0x7fb6a4006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b17fa700 1 -- 172.21.15.31:0/1098250057 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a4012600 con 0x7fb6b4067500 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b17fa700 1 -- 172.21.15.31:0/1098250057 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a4012760 con 0x7fb6b4067500 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a800b180 con 0x7fb6b4067500 2024-04-26T07:28:41.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.404+0000 7fb6b17fa700 1 -- 172.21.15.31:0/1098250057 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a4012ac0 con 0x7fb6b4067500 2024-04-26T07:28:41.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.405+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b4091f10 con 0x7fb6b4067500 2024-04-26T07:28:41.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.405+0000 7fb6b17fa700 1 -- 172.21.15.31:0/1098250057 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb6a4022070 con 0x7fb6b4067500 2024-04-26T07:28:41.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.405+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b40679a0 con 0x7fb6b4067500 2024-04-26T07:28:41.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.406+0000 7fb6b17fa700 1 -- 172.21.15.31:0/1098250057 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb6a404af20 con 0x7fb6b4067500 2024-04-26T07:28:41.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.409+0000 7fb6b17fa700 1 -- 172.21.15.31:0/1098250057 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb6a40337b0 con 0x7fb6b4067500 2024-04-26T07:28:41.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.527+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6b406bbc0 con 0x7fb6b4067500 2024-04-26T07:28:41.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.527+0000 7fb6b17fa700 1 -- 172.21.15.31:0/1098250057 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6a40333a0 con 0x7fb6b4067500 2024-04-26T07:28:41.527 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 >> v1:172.21.15.31:6816/39613 conn(0x7fb694038da0 legacy=0x7fb69403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b4067500 msgr2=0x7fb6b4095190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b4067500 0x7fb6b4095190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb6a400c000 tx=0x7fb6a4006eb0).stop 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 shutdown_connections 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b409c070 0x7fb6b41495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b4067500 0x7fb6b4095190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 --2- 172.21.15.31:0/1098250057 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b409bc70 0x7fb6b41490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 >> 172.21.15.31:0/1098250057 conn(0x7fb6b405cfb0 msgr2=0x7fb6b405fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 shutdown_connections 2024-04-26T07:28:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.528+0000 7fb6ba7ca700 1 -- 172.21.15.31:0/1098250057 wait complete. 2024-04-26T07:28:41.539 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T07:28:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.647+0000 7f35ab22a700 1 Processor -- start 2024-04-26T07:28:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.647+0000 7f35ab22a700 1 -- start start 2024-04-26T07:28:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35ab22a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35a4067d70 0x7f35a4066e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35ab22a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a405c080 0x7f35a4140d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35ab22a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a4066600 con 0x7f35a405dfb0 2024-04-26T07:28:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35ab22a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40a4730 con 0x7f35a4067d70 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35ab22a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40a49d0 con 0x7f35a405c080 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35a8fc6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35a4067d70 0x7f35a4066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35a97c7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a405c080 0x7f35a4140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35a8fc6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35a4067d70 0x7f35a4066e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42262/0 (socket says 172.21.15.31:42262) 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35a8fc6700 1 -- 172.21.15.31:0/965595416 learned_addr learned my addr 172.21.15.31:0/965595416 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35a97c7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a405c080 0x7f35a4140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44108/0 (socket says 172.21.15.31:44108) 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.648+0000 7f35a3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f35a405dfb0 0x7f35a405b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32810/0 (socket says 172.21.15.31:32810) 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a8fc6700 1 -- 172.21.15.31:0/965595416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a405c080 msgr2=0x7f35a4140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a8fc6700 1 --2- 172.21.15.31:0/965595416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a405c080 0x7f35a4140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a8fc6700 1 -- 172.21.15.31:0/965595416 >> v1:172.21.15.31:6789/0 conn(0x7f35a405dfb0 legacy=0x7f35a405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a8fc6700 1 -- 172.21.15.31:0/965595416 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40a38c0 con 0x7f35a4067d70 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a37fe700 1 -- 172.21.15.31:0/965595416 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114719834 0 0) 0x7f35a4066600 con 0x7f35a405dfb0 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a97c7700 1 --2- 172.21.15.31:0/965595416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a405c080 0x7f35a4140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a8fc6700 1 --2- 172.21.15.31:0/965595416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a4067d70 0x7f35a4066e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3598002f70 tx=0x7f3598006eb0).ready entity=mon.0 client_cookie=b02295a89c973e11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a37fe700 1 -- 172.21.15.31:0/965595416 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359800d570 con 0x7f35a4067d70 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a37fe700 1 -- 172.21.15.31:0/965595416 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598000e90 con 0x7f35a4067d70 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35a37fe700 1 -- 172.21.15.31:0/965595416 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359800d8c0 con 0x7f35a4067d70 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35ab22a700 1 -- 172.21.15.31:0/965595416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a4067d70 msgr2=0x7f35a4066e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35ab22a700 1 --2- 172.21.15.31:0/965595416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a4067d70 0x7f35a4066e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3598002f70 tx=0x7f3598006eb0).stop 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35ab22a700 1 -- 172.21.15.31:0/965595416 shutdown_connections 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35ab22a700 1 --2- 172.21.15.31:0/965595416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a405c080 0x7f35a4140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35ab22a700 1 --2- 172.21.15.31:0/965595416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a4067d70 0x7f35a4066e70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35ab22a700 1 -- 172.21.15.31:0/965595416 >> 172.21.15.31:0/965595416 conn(0x7f35a4060ee0 msgr2=0x7f35a40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35ab22a700 1 -- 172.21.15.31:0/965595416 shutdown_connections 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.649+0000 7f35ab22a700 1 -- 172.21.15.31:0/965595416 wait complete. 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.650+0000 7f35ab22a700 1 Processor -- start 2024-04-26T07:28:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.650+0000 7f35ab22a700 1 -- start start 2024-04-26T07:28:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35ab22a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35a405c080 0x7f35a41396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35ab22a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a405dfb0 0x7f35a409c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35ab22a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a4067d70 0x7f35a4145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35ab22a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a413a450 con 0x7f35a405dfb0 2024-04-26T07:28:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35ab22a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4145a80 con 0x7f35a4067d70 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35ab22a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4139ba0 con 0x7f35a405c080 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a405dfb0 0x7f35a409c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a97c7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a4067d70 0x7f35a4145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a405dfb0 0x7f35a409c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42276/0 (socket says 172.21.15.31:42276) 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a3fff700 1 -- 172.21.15.31:0/2421266104 learned_addr learned my addr 172.21.15.31:0/2421266104 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a8fc6700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35a405c080 0x7f35a41396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a97c7700 1 -- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35a405c080 msgr2=0x7f35a41396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a97c7700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35a405c080 0x7f35a41396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a97c7700 1 -- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a405dfb0 msgr2=0x7f35a409c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.651+0000 7f35a97c7700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a405dfb0 0x7f35a409c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.652+0000 7f35a97c7700 1 -- 172.21.15.31:0/2421266104 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c009470 con 0x7f35a4067d70 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.652+0000 7f35a3fff700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a405dfb0 0x7f35a409c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.652+0000 7f35a97c7700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a4067d70 0x7f35a4145d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f359c00c000 tx=0x7f359c0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.652+0000 7f35a1ffb700 1 -- 172.21.15.31:0/2421266104 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359c00ee60 con 0x7f35a4067d70 2024-04-26T07:28:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.652+0000 7f35a1ffb700 1 -- 172.21.15.31:0/2421266104 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c00c850 con 0x7f35a4067d70 2024-04-26T07:28:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.652+0000 7f35a1ffb700 1 -- 172.21.15.31:0/2421266104 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359c00cbb0 con 0x7f35a4067d70 2024-04-26T07:28:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.652+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359800b1e0 con 0x7f35a4067d70 2024-04-26T07:28:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.652+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a4143340 con 0x7f35a4067d70 2024-04-26T07:28:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.653+0000 7f35a1ffb700 1 -- 172.21.15.31:0/2421266104 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f359c022070 con 0x7f35a4067d70 2024-04-26T07:28:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.653+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a40a3f20 con 0x7f35a4067d70 2024-04-26T07:28:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.653+0000 7f35a1ffb700 1 -- 172.21.15.31:0/2421266104 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f359c04afd0 con 0x7f35a4067d70 2024-04-26T07:28:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.656+0000 7f35a1ffb700 1 -- 172.21.15.31:0/2421266104 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f359c06c7c0 con 0x7f35a4067d70 2024-04-26T07:28:41.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.772+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35a406bbc0 con 0x7f35a4067d70 2024-04-26T07:28:41.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.772+0000 7f35a1ffb700 1 -- 172.21.15.31:0/2421266104 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f359c016030 con 0x7f35a4067d70 2024-04-26T07:28:41.773 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-26T07:28:41.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 >> v1:172.21.15.31:6816/39613 conn(0x7f3584038ec0 legacy=0x7f358403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a4067d70 msgr2=0x7f35a4145d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a4067d70 0x7f35a4145d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f359c00c000 tx=0x7f359c0091d0).stop 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 shutdown_connections 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35a405c080 0x7f35a41396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35a4067d70 0x7f35a4145d40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 --2- 172.21.15.31:0/2421266104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a405dfb0 0x7f35a409c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 >> 172.21.15.31:0/2421266104 conn(0x7f35a4060ee0 msgr2=0x7f35a40a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 shutdown_connections 2024-04-26T07:28:41.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.774+0000 7f35ab22a700 1 -- 172.21.15.31:0/2421266104 wait complete. 2024-04-26T07:28:41.785 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T07:28:41.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.896+0000 7fec79259700 1 Processor -- start 2024-04-26T07:28:41.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.896+0000 7fec79259700 1 -- start start 2024-04-26T07:28:41.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec79259700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec74067500 0x7fec7409a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec79259700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec7409c070 0x7fec74136d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec79259700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7409b670 con 0x7fec7409bc70 2024-04-26T07:28:41.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec79259700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec741361b0 con 0x7fec7409c070 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec79259700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7409b400 con 0x7fec74067500 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec72d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec74067500 0x7fec7409a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec7359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec7409c070 0x7fec74136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec72d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec74067500 0x7fec7409a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44122/0 (socket says 172.21.15.31:44122) 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec7359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec7409c070 0x7fec74136d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42290/0 (socket says 172.21.15.31:42290) 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec7259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fec7409bc70 0x7fec74136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32814/0 (socket says 172.21.15.31:32814) 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.897+0000 7fec72d9d700 1 -- 172.21.15.31:0/3390254829 learned_addr learned my addr 172.21.15.31:0/3390254829 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec72d9d700 1 -- 172.21.15.31:0/3390254829 >> v2:172.21.15.31:3300/0 conn(0x7fec7409c070 msgr2=0x7fec74136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec72d9d700 1 --2- 172.21.15.31:0/3390254829 >> v2:172.21.15.31:3300/0 conn(0x7fec7409c070 0x7fec74136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec72d9d700 1 -- 172.21.15.31:0/3390254829 >> v1:172.21.15.31:6789/0 conn(0x7fec7409bc70 legacy=0x7fec74136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec71d9b700 1 -- 172.21.15.31:0/3390254829 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169423140 0 0) 0x7fec7409b670 con 0x7fec7409bc70 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec72d9d700 1 -- 172.21.15.31:0/3390254829 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec741363a0 con 0x7fec74067500 2024-04-26T07:28:41.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec7359e700 1 --2- 172.21.15.31:0/3390254829 >> v2:172.21.15.31:3300/0 conn(0x7fec7409c070 0x7fec74136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec72d9d700 1 --2- 172.21.15.31:0/3390254829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec74067500 0x7fec7409a8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fec64002f70 tx=0x7fec64006eb0).ready entity=mon.1 client_cookie=3fe1b1bd75321e1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec71d9b700 1 -- 172.21.15.31:0/3390254829 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6400d570 con 0x7fec74067500 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec71d9b700 1 -- 172.21.15.31:0/3390254829 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec64000e90 con 0x7fec74067500 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec71d9b700 1 -- 172.21.15.31:0/3390254829 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6400d8c0 con 0x7fec74067500 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec79259700 1 -- 172.21.15.31:0/3390254829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec74067500 msgr2=0x7fec7409a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.898+0000 7fec79259700 1 --2- 172.21.15.31:0/3390254829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec74067500 0x7fec7409a8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fec64002f70 tx=0x7fec64006eb0).stop 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.899+0000 7fec79259700 1 -- 172.21.15.31:0/3390254829 shutdown_connections 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.899+0000 7fec79259700 1 --2- 172.21.15.31:0/3390254829 >> v2:172.21.15.31:3300/0 conn(0x7fec7409c070 0x7fec74136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.899+0000 7fec79259700 1 --2- 172.21.15.31:0/3390254829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec74067500 0x7fec7409a8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.899+0000 7fec79259700 1 -- 172.21.15.31:0/3390254829 >> 172.21.15.31:0/3390254829 conn(0x7fec7405cfb0 msgr2=0x7fec74062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:41.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.899+0000 7fec79259700 1 -- 172.21.15.31:0/3390254829 shutdown_connections 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.899+0000 7fec79259700 1 -- 172.21.15.31:0/3390254829 wait complete. 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.899+0000 7fec79259700 1 Processor -- start 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.899+0000 7fec79259700 1 -- start start 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec79259700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec74067500 0x7fec741460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec79259700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec7409bc70 0x7fec74093b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec79259700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec7409c070 0x7fec74149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec79259700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec74093390 con 0x7fec7409bc70 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec79259700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec741465a0 con 0x7fec7409c070 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec79259700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec74148ea0 con 0x7fec74067500 2024-04-26T07:28:41.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec7409bc70 0x7fec74093b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec7409c070 0x7fec74149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7359e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec7409c070 0x7fec74149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44134/0 (socket says 172.21.15.31:44134) 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7359e700 1 -- 172.21.15.31:0/644518091 learned_addr learned my addr 172.21.15.31:0/644518091 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec72d9d700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec74067500 0x7fec741460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7259c700 1 -- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec74067500 msgr2=0x7fec741460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7259c700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec74067500 0x7fec741460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7259c700 1 -- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec7409c070 msgr2=0x7fec74149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7259c700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec7409c070 0x7fec74149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7259c700 1 -- 172.21.15.31:0/644518091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009470 con 0x7fec7409bc70 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.900+0000 7fec7359e700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec7409c070 0x7fec74149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.901+0000 7fec7259c700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec7409bc70 0x7fec74093b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fec68000bc0 tx=0x7fec680079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.901+0000 7fec63fff700 1 -- 172.21.15.31:0/644518091 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6800cdd0 con 0x7fec7409bc70 2024-04-26T07:28:41.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.901+0000 7fec63fff700 1 -- 172.21.15.31:0/644518091 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680070d0 con 0x7fec7409bc70 2024-04-26T07:28:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.901+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6400b1e0 con 0x7fec7409bc70 2024-04-26T07:28:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.901+0000 7fec63fff700 1 -- 172.21.15.31:0/644518091 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec68005550 con 0x7fec7409bc70 2024-04-26T07:28:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.901+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec74145b60 con 0x7fec7409bc70 2024-04-26T07:28:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.902+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec740679a0 con 0x7fec7409bc70 2024-04-26T07:28:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.902+0000 7fec63fff700 1 -- 172.21.15.31:0/644518091 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fec6801a060 con 0x7fec7409bc70 2024-04-26T07:28:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.902+0000 7fec63fff700 1 -- 172.21.15.31:0/644518091 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fec68049ef0 con 0x7fec7409bc70 2024-04-26T07:28:41.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:41.905+0000 7fec63fff700 1 -- 172.21.15.31:0/644518091 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fec6802edf0 con 0x7fec7409bc70 2024-04-26T07:28:42.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.021+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec74062b20 con 0x7fec7409bc70 2024-04-26T07:28:42.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.021+0000 7fec63fff700 1 -- 172.21.15.31:0/644518091 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec68018070 con 0x7fec7409bc70 2024-04-26T07:28:42.021 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.022+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 >> v1:172.21.15.31:6816/39613 conn(0x7fec50038da0 legacy=0x7fec5003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.022+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec7409bc70 msgr2=0x7fec74093b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.022+0000 7fec79259700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec7409bc70 0x7fec74093b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fec68000bc0 tx=0x7fec680079e0).stop 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.022+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 shutdown_connections 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.022+0000 7fec79259700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec74067500 0x7fec741460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.022+0000 7fec79259700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec7409c070 0x7fec74149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.022+0000 7fec79259700 1 --2- 172.21.15.31:0/644518091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec7409bc70 0x7fec74093b70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.022+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 >> 172.21.15.31:0/644518091 conn(0x7fec7405cfb0 msgr2=0x7fec740a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.023+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 shutdown_connections 2024-04-26T07:28:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.023+0000 7fec79259700 1 -- 172.21.15.31:0/644518091 wait complete. 2024-04-26T07:28:42.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:42.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.140+0000 7fdd0cfbe700 1 Processor -- start 2024-04-26T07:28:42.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.140+0000 7fdd0cfbe700 1 -- start start 2024-04-26T07:28:42.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.140+0000 7fdd0cfbe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd081360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.140+0000 7fdd0cfbe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd08096320 0x7fdd0805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.140+0000 7fdd0cfbe700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd080970a0 con 0x7fdd0805be60 2024-04-26T07:28:42.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.140+0000 7fdd0cfbe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd08133c10 con 0x7fdd08096320 2024-04-26T07:28:42.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.140+0000 7fdd0cfbe700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08136780 con 0x7fdd0806c7d0 2024-04-26T07:28:42.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd0659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd081360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd05d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd08096320 0x7fdd0805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd06d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdd0805be60 0x7fdd08140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32830/0 (socket says 172.21.15.31:32830) 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd06d9d700 1 -- 172.21.15.31:0/722548856 learned_addr learned my addr 172.21.15.31:0/722548856 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd05d9b700 1 -- 172.21.15.31:0/722548856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 msgr2=0x7fdd081360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd05d9b700 1 --2- 172.21.15.31:0/722548856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd081360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd05d9b700 1 -- 172.21.15.31:0/722548856 >> v1:172.21.15.31:6789/0 conn(0x7fdd0805be60 legacy=0x7fdd08140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd0559a700 1 -- 172.21.15.31:0/722548856 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595191299 0 0) 0x7fdd080970a0 con 0x7fdd0805be60 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd05d9b700 1 -- 172.21.15.31:0/722548856 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08136a40 con 0x7fdd08096320 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd0659c700 1 --2- 172.21.15.31:0/722548856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd081360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd05d9b700 1 --2- 172.21.15.31:0/722548856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd0805b970 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fdcfc002f70 tx=0x7fdcfc006df0).ready entity=mon.0 client_cookie=8131d3e5d7d800e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd0559a700 1 -- 172.21.15.31:0/722548856 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcfc00d570 con 0x7fdd08096320 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd0559a700 1 -- 172.21.15.31:0/722548856 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc000e90 con 0x7fdd08096320 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.141+0000 7fdd0559a700 1 -- 172.21.15.31:0/722548856 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcfc00d8c0 con 0x7fdd08096320 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.142+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/722548856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 msgr2=0x7fdd0805b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.142+0000 7fdd0cfbe700 1 --2- 172.21.15.31:0/722548856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd0805b970 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fdcfc002f70 tx=0x7fdcfc006df0).stop 2024-04-26T07:28:42.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.142+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/722548856 shutdown_connections 2024-04-26T07:28:42.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.142+0000 7fdd0cfbe700 1 --2- 172.21.15.31:0/722548856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd081360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.142+0000 7fdd0cfbe700 1 --2- 172.21.15.31:0/722548856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd0805b970 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.142+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/722548856 >> 172.21.15.31:0/722548856 conn(0x7fdd08061370 msgr2=0x7fdd0806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:42.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.142+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/722548856 shutdown_connections 2024-04-26T07:28:42.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.142+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/722548856 wait complete. 2024-04-26T07:28:42.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.143+0000 7fdd0cfbe700 1 Processor -- start 2024-04-26T07:28:42.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.143+0000 7fdd0cfbe700 1 -- start start 2024-04-26T07:28:42.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.143+0000 7fdd0cfbe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0805be60 0x7fdd08066b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.143+0000 7fdd0cfbe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd08148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.143+0000 7fdd0cfbe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd08149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.143+0000 7fdd0cfbe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08064110 con 0x7fdd08096320 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.143+0000 7fdd0cfbe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080643d0 con 0x7fdd0805be60 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.143+0000 7fdd0cfbe700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08066620 con 0x7fdd0806c7d0 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd05d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd08148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd0659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0805be60 0x7fdd08066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd06d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd08149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd0659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0805be60 0x7fdd08066b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44142/0 (socket says 172.21.15.31:44142) 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd05d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd08148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34894/0 (socket says 172.21.15.31:34894) 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd06d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd08149490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42312/0 (socket says 172.21.15.31:42312) 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd0659c700 1 -- 172.21.15.31:0/1349311278 learned_addr learned my addr 172.21.15.31:0/1349311278 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd06d9d700 1 -- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 msgr2=0x7fdd08148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd06d9d700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd08148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd06d9d700 1 -- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0805be60 msgr2=0x7fdd08066b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd06d9d700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0805be60 0x7fdd08066b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd06d9d700 1 -- 172.21.15.31:0/1349311278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf800b180 con 0x7fdd08096320 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd05d9b700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd08148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd0659c700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0805be60 0x7fdd08066b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd06d9d700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd08149490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fdd00001250 tx=0x7fdd00007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdcf77fe700 1 -- 172.21.15.31:0/1349311278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd00005ba0 con 0x7fdd08096320 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdcf77fe700 1 -- 172.21.15.31:0/1349311278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00005d00 con 0x7fdd08096320 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc00b180 con 0x7fdd08096320 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdcf77fe700 1 -- 172.21.15.31:0/1349311278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd00004a90 con 0x7fdd08096320 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.144+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd08067e30 con 0x7fdd08096320 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.145+0000 7fdcf77fe700 1 -- 172.21.15.31:0/1349311278 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdd00004bf0 con 0x7fdd08096320 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.145+0000 7fdcf77fe700 1 -- 172.21.15.31:0/1349311278 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdd0004a2e0 con 0x7fdd08096320 2024-04-26T07:28:42.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.145+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd080975a0 con 0x7fdd08096320 2024-04-26T07:28:42.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.149+0000 7fdcf77fe700 1 -- 172.21.15.31:0/1349311278 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdd0002f1e0 con 0x7fdd08096320 2024-04-26T07:28:42.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.298+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd08097f90 con 0x7fdd08096320 2024-04-26T07:28:42.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.299+0000 7fdcf77fe700 1 -- 172.21.15.31:0/1349311278 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2320 (secure 0 0 0) 0x7fdd00032800 con 0x7fdd08096320 2024-04-26T07:28:42.299 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:42.299 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:34.834435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:28:42.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 >> v1:172.21.15.31:6816/39613 conn(0x7fdce4038da0 legacy=0x7fdce403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 msgr2=0x7fdd08149490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd08149490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fdd00001250 tx=0x7fdd00007d00).stop 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 shutdown_connections 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd08096320 0x7fdd08149490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0805be60 0x7fdd08066b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 --2- 172.21.15.31:0/1349311278 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0806c7d0 0x7fdd08148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 >> 172.21.15.31:0/1349311278 conn(0x7fdd08061370 msgr2=0x7fdd08099810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 shutdown_connections 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.300+0000 7fdd0cfbe700 1 -- 172.21.15.31:0/1349311278 wait complete. 2024-04-26T07:28:42.301 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 9 2024-04-26T07:28:42.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:42.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.418+0000 7fa5cc159700 1 Processor -- start 2024-04-26T07:28:42.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.418+0000 7fa5cc159700 1 -- start start 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5cc159700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134460 0x7fa5c4065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5cc159700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c413c830 0x7fa5c413ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5cc159700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c4065770 con 0x7fa5c4134840 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5cc159700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c409c5e0 con 0x7fa5c4134460 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5cc159700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4134240 con 0x7fa5c413c830 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c9ef5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134460 0x7fa5c4065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5ca6f6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c413c830 0x7fa5c413ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c96f4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa5c4134840 0x7fa5c40635b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32842/0 (socket says 172.21.15.31:32842) 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c96f4700 1 -- 172.21.15.31:0/3508243501 learned_addr learned my addr 172.21.15.31:0/3508243501 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:42.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c8ef3700 1 -- 172.21.15.31:0/3508243501 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890165420 0 0) 0x7fa5b4001110 con 0x7fa5c4134840 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c8ef3700 1 -- 172.21.15.31:0/3508243501 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ac003260 con 0x7fa5c4134840 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5ca6f6700 1 -- 172.21.15.31:0/3508243501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134460 msgr2=0x7fa5c4065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5ca6f6700 1 --2- 172.21.15.31:0/3508243501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134460 0x7fa5c4065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5ca6f6700 1 -- 172.21.15.31:0/3508243501 >> v1:172.21.15.31:6789/0 conn(0x7fa5c4134840 legacy=0x7fa5c40635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5ca6f6700 1 -- 172.21.15.31:0/3508243501 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c4063cc0 con 0x7fa5c413c830 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c9ef5700 1 --2- 172.21.15.31:0/3508243501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134460 0x7fa5c4065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5ca6f6700 1 --2- 172.21.15.31:0/3508243501 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c413c830 0x7fa5c413ec20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa5bc0032f0 tx=0x7fa5bc0091d0).ready entity=mon.2 client_cookie=cc4e46ab1ccd507c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c8ef3700 1 -- 172.21.15.31:0/3508243501 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5bc00b640 con 0x7fa5c413c830 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c8ef3700 1 -- 172.21.15.31:0/3508243501 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00b7a0 con 0x7fa5c413c830 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.419+0000 7fa5c8ef3700 1 -- 172.21.15.31:0/3508243501 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5bc00b910 con 0x7fa5c413c830 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.420+0000 7fa5cc159700 1 -- 172.21.15.31:0/3508243501 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c413c830 msgr2=0x7fa5c413ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.420+0000 7fa5cc159700 1 --2- 172.21.15.31:0/3508243501 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c413c830 0x7fa5c413ec20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa5bc0032f0 tx=0x7fa5bc0091d0).stop 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.420+0000 7fa5cc159700 1 -- 172.21.15.31:0/3508243501 shutdown_connections 2024-04-26T07:28:42.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.420+0000 7fa5cc159700 1 --2- 172.21.15.31:0/3508243501 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c413c830 0x7fa5c413ec20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.420+0000 7fa5cc159700 1 --2- 172.21.15.31:0/3508243501 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134460 0x7fa5c4065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.420+0000 7fa5cc159700 1 -- 172.21.15.31:0/3508243501 >> 172.21.15.31:0/3508243501 conn(0x7fa5c405cfb0 msgr2=0x7fa5c4062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:42.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.420+0000 7fa5cc159700 1 -- 172.21.15.31:0/3508243501 shutdown_connections 2024-04-26T07:28:42.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.420+0000 7fa5cc159700 1 -- 172.21.15.31:0/3508243501 wait complete. 2024-04-26T07:28:42.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.421+0000 7fa5cc159700 1 Processor -- start 2024-04-26T07:28:42.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.421+0000 7fa5cc159700 1 -- start start 2024-04-26T07:28:42.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5cc159700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c4134460 0x7fa5c4135900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5cc159700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134840 0x7fa5c4130e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5cc159700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c413c830 0x7fa5c41312f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5cc159700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4137140 con 0x7fa5c413c830 2024-04-26T07:28:42.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5cc159700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c405fef0 con 0x7fa5c4134840 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5cc159700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4061860 con 0x7fa5c4134460 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5c9ef5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c4134460 0x7fa5c4135900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5c9ef5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c4134460 0x7fa5c4135900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34910/0 (socket says 172.21.15.31:34910) 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5c9ef5700 1 -- 172.21.15.31:0/4188401278 learned_addr learned my addr 172.21.15.31:0/4188401278 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5ca6f6700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c413c830 0x7fa5c41312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5c96f4700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134840 0x7fa5c4130e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5ca6f6700 1 -- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c4134460 msgr2=0x7fa5c4135900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5ca6f6700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c4134460 0x7fa5c4135900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5ca6f6700 1 -- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134840 msgr2=0x7fa5c4130e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5ca6f6700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134840 0x7fa5c4130e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5ca6f6700 1 -- 172.21.15.31:0/4188401278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c000b180 con 0x7fa5c413c830 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5c9ef5700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c4134460 0x7fa5c4135900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5c96f4700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134840 0x7fa5c4130e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5ca6f6700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c413c830 0x7fa5c41312f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa5bc0032f0 tx=0x7fa5bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:42.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5b2ffd700 1 -- 172.21.15.31:0/4188401278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5bc00b640 con 0x7fa5c413c830 2024-04-26T07:28:42.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5b2ffd700 1 -- 172.21.15.31:0/4188401278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc0205e0 con 0x7fa5c413c830 2024-04-26T07:28:42.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5b2ffd700 1 -- 172.21.15.31:0/4188401278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5bc00bee0 con 0x7fa5c413c830 2024-04-26T07:28:42.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc009470 con 0x7fa5c413c830 2024-04-26T07:28:42.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.422+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c4135360 con 0x7fa5c413c830 2024-04-26T07:28:42.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.423+0000 7fa5b2ffd700 1 -- 172.21.15.31:0/4188401278 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa5bc01e070 con 0x7fa5c413c830 2024-04-26T07:28:42.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.423+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c4133f10 con 0x7fa5c413c830 2024-04-26T07:28:42.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.424+0000 7fa5b2ffd700 1 -- 172.21.15.31:0/4188401278 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa5bc04adf0 con 0x7fa5c413c830 2024-04-26T07:28:42.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.427+0000 7fa5b2ffd700 1 -- 172.21.15.31:0/4188401278 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa5bc020940 con 0x7fa5c413c830 2024-04-26T07:28:42.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.543+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5c4062b20 con 0x7fa5c413c830 2024-04-26T07:28:42.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.544+0000 7fa5b2ffd700 1 -- 172.21.15.31:0/4188401278 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7fa5bc015030 con 0x7fa5c413c830 2024-04-26T07:28:42.544 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:42.544 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:32.133218+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:42.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 >> v1:172.21.15.31:6816/39613 conn(0x7fa5a4038e30 legacy=0x7fa5a403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c413c830 msgr2=0x7fa5c41312f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c413c830 0x7fa5c41312f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa5bc0032f0 tx=0x7fa5bc016000).stop 2024-04-26T07:28:42.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 shutdown_connections 2024-04-26T07:28:42.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5c4134460 0x7fa5c4135900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c413c830 0x7fa5c41312f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 --2- 172.21.15.31:0/4188401278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5c4134840 0x7fa5c4130e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 >> 172.21.15.31:0/4188401278 conn(0x7fa5c405cfb0 msgr2=0x7fa5c406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:42.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 shutdown_connections 2024-04-26T07:28:42.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.545+0000 7fa5cc159700 1 -- 172.21.15.31:0/4188401278 wait complete. 2024-04-26T07:28:42.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T07:28:28.939656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T07:28:30.129744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T07:28:42.557 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:28:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5d1352700 1 Processor -- start 2024-04-26T07:28:42.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5d1352700 1 -- start start 2024-04-26T07:28:42.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5d1352700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5cc1360f0 0x7fc5cc096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5d1352700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc05c080 0x7fc5cc141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5d1352700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc0970a0 con 0x7fc5cc06c7d0 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5d1352700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc133c10 con 0x7fc5cc1360f0 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5d1352700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc136500 con 0x7fc5cc05c080 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5ca7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5cc1360f0 0x7fc5cc096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.666+0000 7fc5cb7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc05c080 0x7fc5cc141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5caffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc5cc06c7d0 0x7fc5cc05b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32846/0 (socket says 172.21.15.31:32846) 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5cb7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc05c080 0x7fc5cc141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34916/0 (socket says 172.21.15.31:34916) 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5ca7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc5cc1360f0 0x7fc5cc096320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42332/0 (socket says 172.21.15.31:42332) 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5caffd700 1 -- 172.21.15.31:0/618050269 learned_addr learned my addr 172.21.15.31:0/618050269 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5cb7fe700 1 -- 172.21.15.31:0/618050269 >> v2:172.21.15.31:3300/0 conn(0x7fc5cc1360f0 msgr2=0x7fc5cc096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5cb7fe700 1 --2- 172.21.15.31:0/618050269 >> v2:172.21.15.31:3300/0 conn(0x7fc5cc1360f0 0x7fc5cc096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5cb7fe700 1 -- 172.21.15.31:0/618050269 >> v1:172.21.15.31:6789/0 conn(0x7fc5cc06c7d0 legacy=0x7fc5cc05b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5c9ffb700 1 -- 172.21.15.31:0/618050269 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183471755 0 0) 0x7fc5cc0970a0 con 0x7fc5cc06c7d0 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5cb7fe700 1 -- 172.21.15.31:0/618050269 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc096810 con 0x7fc5cc05c080 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5ca7fc700 1 --2- 172.21.15.31:0/618050269 >> v2:172.21.15.31:3300/0 conn(0x7fc5cc1360f0 0x7fc5cc096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5cb7fe700 1 --2- 172.21.15.31:0/618050269 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc05c080 0x7fc5cc141a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc5c40032f0 tx=0x7fc5c40091d0).ready entity=mon.2 client_cookie=a1671b506aca87df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5c9ffb700 1 -- 172.21.15.31:0/618050269 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5c400b6c0 con 0x7fc5cc05c080 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5c9ffb700 1 -- 172.21.15.31:0/618050269 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c400b820 con 0x7fc5cc05c080 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.667+0000 7fc5c9ffb700 1 -- 172.21.15.31:0/618050269 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5c400b990 con 0x7fc5cc05c080 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.668+0000 7fc5d1352700 1 -- 172.21.15.31:0/618050269 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc05c080 msgr2=0x7fc5cc141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.668+0000 7fc5d1352700 1 --2- 172.21.15.31:0/618050269 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc05c080 0x7fc5cc141a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc5c40032f0 tx=0x7fc5c40091d0).stop 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.668+0000 7fc5d1352700 1 -- 172.21.15.31:0/618050269 shutdown_connections 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.668+0000 7fc5d1352700 1 --2- 172.21.15.31:0/618050269 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc05c080 0x7fc5cc141a50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.668+0000 7fc5d1352700 1 --2- 172.21.15.31:0/618050269 >> v2:172.21.15.31:3300/0 conn(0x7fc5cc1360f0 0x7fc5cc096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.668+0000 7fc5d1352700 1 -- 172.21.15.31:0/618050269 >> 172.21.15.31:0/618050269 conn(0x7fc5cc061370 msgr2=0x7fc5cc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.668+0000 7fc5d1352700 1 -- 172.21.15.31:0/618050269 shutdown_connections 2024-04-26T07:28:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.668+0000 7fc5d1352700 1 -- 172.21.15.31:0/618050269 wait complete. 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5d1352700 1 Processor -- start 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5d1352700 1 -- start start 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5d1352700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5cc05c080 0x7fc5cc064870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5d1352700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc06c7d0 0x7fc5cc062000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5d1352700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5cc1360f0 0x7fc5cc0624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5d1352700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0637b0 con 0x7fc5cc05c080 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5d1352700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc065c40 con 0x7fc5cc1360f0 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5d1352700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc065ee0 con 0x7fc5cc06c7d0 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5cb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5cc1360f0 0x7fc5cc0624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5ca7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc06c7d0 0x7fc5cc062000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5cb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5cc1360f0 0x7fc5cc0624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44156/0 (socket says 172.21.15.31:44156) 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5cb7fe700 1 -- 172.21.15.31:0/2805455732 learned_addr learned my addr 172.21.15.31:0/2805455732 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.669+0000 7fc5ca7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc06c7d0 0x7fc5cc062000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34926/0 (socket says 172.21.15.31:34926) 2024-04-26T07:28:42.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5caffd700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5cc05c080 0x7fc5cc064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5cb7fe700 1 -- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc06c7d0 msgr2=0x7fc5cc062000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5cb7fe700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc06c7d0 0x7fc5cc062000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5cb7fe700 1 -- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5cc05c080 msgr2=0x7fc5cc064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5cb7fe700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5cc05c080 0x7fc5cc064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5cb7fe700 1 -- 172.21.15.31:0/2805455732 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b400b180 con 0x7fc5cc1360f0 2024-04-26T07:28:42.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5ca7fc700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc06c7d0 0x7fc5cc062000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5cb7fe700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5cc1360f0 0x7fc5cc0624f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc5c40032f0 tx=0x7fc5c4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:42.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5c3fff700 1 -- 172.21.15.31:0/2805455732 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5c400b6c0 con 0x7fc5cc1360f0 2024-04-26T07:28:42.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5c3fff700 1 -- 172.21.15.31:0/2805455732 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c4021630 con 0x7fc5cc1360f0 2024-04-26T07:28:42.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c4009470 con 0x7fc5cc1360f0 2024-04-26T07:28:42.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5c3fff700 1 -- 172.21.15.31:0/2805455732 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5c4021990 con 0x7fc5cc1360f0 2024-04-26T07:28:42.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.670+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc139fd0 con 0x7fc5cc1360f0 2024-04-26T07:28:42.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.671+0000 7fc5c3fff700 1 -- 172.21.15.31:0/2805455732 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc5c400f070 con 0x7fc5cc1360f0 2024-04-26T07:28:42.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.671+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc136780 con 0x7fc5cc1360f0 2024-04-26T07:28:42.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.671+0000 7fc5c3fff700 1 -- 172.21.15.31:0/2805455732 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc5c404b570 con 0x7fc5cc1360f0 2024-04-26T07:28:42.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.674+0000 7fc5c3fff700 1 -- 172.21.15.31:0/2805455732 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc5c4015030 con 0x7fc5cc1360f0 2024-04-26T07:28:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.791+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc5cc06bbc0 con 0x7fc5cc1360f0 2024-04-26T07:28:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.792+0000 7fc5c3fff700 1 -- 172.21.15.31:0/2805455732 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc5c4024710 con 0x7fc5cc1360f0 2024-04-26T07:28:42.792 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 >> v1:172.21.15.31:6816/39613 conn(0x7fc5b0038dd0 legacy=0x7fc5b003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5cc1360f0 msgr2=0x7fc5cc0624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5cc1360f0 0x7fc5cc0624f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc5c40032f0 tx=0x7fc5c4016000).stop 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 shutdown_connections 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc5cc1360f0 0x7fc5cc0624f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5cc05c080 0x7fc5cc064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 --2- 172.21.15.31:0/2805455732 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc5cc06c7d0 0x7fc5cc062000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 >> 172.21.15.31:0/2805455732 conn(0x7fc5cc061370 msgr2=0x7fc5cc09ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 shutdown_connections 2024-04-26T07:28:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.793+0000 7fc5d1352700 1 -- 172.21.15.31:0/2805455732 wait complete. 2024-04-26T07:28:42.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:28:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.914+0000 7faa34c5c700 1 Processor -- start 2024-04-26T07:28:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.914+0000 7faa34c5c700 1 -- start start 2024-04-26T07:28:42.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa34c5c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa3009c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa34c5c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa300a2680 0x7faa300a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa34c5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a3660 0x7faa300a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa34c5c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa300a4000 con 0x7faa300a2680 2024-04-26T07:28:42.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa34c5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3009d150 con 0x7faa300a3660 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa34c5c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa3009dd80 con 0x7faa300a22a0 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa2dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa300a2680 0x7faa300a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa2ed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a3660 0x7faa300a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa2e59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa3009c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa2dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa300a2680 0x7faa300a3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42346/0 (socket says 172.21.15.31:42346) 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa2ed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a3660 0x7faa300a3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44168/0 (socket says 172.21.15.31:44168) 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa2e59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa3009c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34930/0 (socket says 172.21.15.31:34930) 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.915+0000 7faa2dd9b700 1 -- 172.21.15.31:0/163641553 learned_addr learned my addr 172.21.15.31:0/163641553 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2dd9b700 1 -- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 msgr2=0x7faa3009c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2dd9b700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa3009c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2dd9b700 1 -- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a3660 msgr2=0x7faa300a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2dd9b700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a3660 0x7faa300a3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2dd9b700 1 -- 172.21.15.31:0/163641553 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3009ce90 con 0x7faa300a2680 2024-04-26T07:28:42.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2e59c700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa3009c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2ed9d700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a3660 0x7faa300a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2dd9b700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a2680 0x7faa300a3170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7faa18002f70 tx=0x7faa18006eb0).ready entity=mon.0 client_cookie=91f16756b7ab83bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2d59a700 1 -- 172.21.15.31:0/163641553 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa1800d570 con 0x7faa300a2680 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2d59a700 1 -- 172.21.15.31:0/163641553 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18000e90 con 0x7faa300a2680 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa2d59a700 1 -- 172.21.15.31:0/163641553 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa1800d8c0 con 0x7faa300a2680 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa34c5c700 1 -- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a2680 msgr2=0x7faa300a3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa34c5c700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a2680 0x7faa300a3170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7faa18002f70 tx=0x7faa18006eb0).stop 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa34c5c700 1 -- 172.21.15.31:0/163641553 shutdown_connections 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa34c5c700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a3660 0x7faa300a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa34c5c700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa3009c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa34c5c700 1 --2- 172.21.15.31:0/163641553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a2680 0x7faa300a3170 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.916+0000 7faa34c5c700 1 -- 172.21.15.31:0/163641553 >> 172.21.15.31:0/163641553 conn(0x7faa30060ee0 msgr2=0x7faa300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.917+0000 7faa34c5c700 1 -- 172.21.15.31:0/163641553 shutdown_connections 2024-04-26T07:28:42.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.917+0000 7faa34c5c700 1 -- 172.21.15.31:0/163641553 wait complete. 2024-04-26T07:28:42.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.917+0000 7faa34c5c700 1 Processor -- start 2024-04-26T07:28:42.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.917+0000 7faa34c5c700 1 -- start start 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa34c5c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa30065c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa34c5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a2680 0x7faa30133490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa34c5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a3660 0x7faa30133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa34c5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa300631c0 con 0x7faa300a3660 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa34c5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa30065130 con 0x7faa300a2680 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa34c5c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa3009bd30 con 0x7faa300a22a0 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2e59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa30065c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a3660 0x7faa30133980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2dd9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a2680 0x7faa30133490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a3660 0x7faa30133980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42358/0 (socket says 172.21.15.31:42358) 2024-04-26T07:28:42.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2e59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa30065c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34942/0 (socket says 172.21.15.31:34942) 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2ed9d700 1 -- 172.21.15.31:0/1815544252 learned_addr learned my addr 172.21.15.31:0/1815544252 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2dd9b700 1 -- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 msgr2=0x7faa30065c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2dd9b700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa30065c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2dd9b700 1 -- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a3660 msgr2=0x7faa30133980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2dd9b700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a3660 0x7faa30133980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2dd9b700 1 -- 172.21.15.31:0/1815544252 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2000d410 con 0x7faa300a2680 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2e59c700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa30065c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2ed9d700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a3660 0x7faa30133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.918+0000 7faa2dd9b700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a2680 0x7faa30133490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faa18002f70 tx=0x7faa18015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.919+0000 7faa277fe700 1 -- 172.21.15.31:0/1815544252 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa180116e0 con 0x7faa300a2680 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.919+0000 7faa277fe700 1 -- 172.21.15.31:0/1815544252 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18011840 con 0x7faa300a2680 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.919+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa28009470 con 0x7faa300a2680 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.919+0000 7faa277fe700 1 -- 172.21.15.31:0/1815544252 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa18011ba0 con 0x7faa300a2680 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.919+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1800b1e0 con 0x7faa300a2680 2024-04-26T07:28:42.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.920+0000 7faa277fe700 1 -- 172.21.15.31:0/1815544252 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7faa1801a040 con 0x7faa300a2680 2024-04-26T07:28:42.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.920+0000 7faa277fe700 1 -- 172.21.15.31:0/1815544252 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7faa1804b4f0 con 0x7faa300a2680 2024-04-26T07:28:42.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.920+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3006bbc0 con 0x7faa300a2680 2024-04-26T07:28:42.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:42.923+0000 7faa277fe700 1 -- 172.21.15.31:0/1815544252 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7faa18008b40 con 0x7faa300a2680 2024-04-26T07:28:43.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.040+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa300a4f90 con 0x7faa300a2680 2024-04-26T07:28:43.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.040+0000 7faa277fe700 1 -- 172.21.15.31:0/1815544252 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7faa180080e0 con 0x7faa300a2680 2024-04-26T07:28:43.040 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.041+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 >> v1:172.21.15.31:6816/39613 conn(0x7faa14038e30 legacy=0x7faa1403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.041+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a2680 msgr2=0x7faa30133490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.041+0000 7faa34c5c700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a2680 0x7faa30133490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faa18002f70 tx=0x7faa18015000).stop 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.041+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 shutdown_connections 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.042+0000 7faa34c5c700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa300a22a0 0x7faa30065c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.042+0000 7faa34c5c700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa300a3660 0x7faa30133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.042+0000 7faa34c5c700 1 --2- 172.21.15.31:0/1815544252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa300a2680 0x7faa30133490 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.042+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 >> 172.21.15.31:0/1815544252 conn(0x7faa30060ee0 msgr2=0x7faa3005c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:43.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.042+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 shutdown_connections 2024-04-26T07:28:43.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.042+0000 7faa34c5c700 1 -- 172.21.15.31:0/1815544252 wait complete. 2024-04-26T07:28:43.052 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T07:28:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.161+0000 7f0fa1925700 1 Processor -- start 2024-04-26T07:28:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.161+0000 7f0fa1925700 1 -- start start 2024-04-26T07:28:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0fa1925700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0f9c0aca60 0x7f0f9c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0fa1925700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0a8af0 0x7f0f9c05cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0fa1925700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c05b970 con 0x7f0f9c139510 2024-04-26T07:28:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0fa1925700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c05c3d0 con 0x7f0f9c0aca60 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0fa1925700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c05d0a0 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0f9c0aca60 0x7f0f9c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9a7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0a8af0 0x7f0f9c05cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0f9c0aca60 0x7f0f9c0ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42374/0 (socket says 172.21.15.31:42374) 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9a7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0a8af0 0x7f0f9c05cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34958/0 (socket says 172.21.15.31:34958) 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9affd700 1 -- 172.21.15.31:0/404114782 learned_addr learned my addr 172.21.15.31:0/404114782 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9affd700 1 -- 172.21.15.31:0/404114782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0a8af0 msgr2=0x7f0f9c05cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9affd700 1 --2- 172.21.15.31:0/404114782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0a8af0 0x7f0f9c05cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9affd700 1 -- 172.21.15.31:0/404114782 >> v1:172.21.15.31:6789/0 conn(0x7f0f9c139510 legacy=0x7f0f9c1399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9affd700 1 -- 172.21.15.31:0/404114782 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c05d300 con 0x7f0f9c0aca60 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f99ffb700 1 -- 172.21.15.31:0/404114782 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209409074 0 0) 0x7f0f9c05b970 con 0x7f0f9c139510 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9a7fc700 1 --2- 172.21.15.31:0/404114782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0a8af0 0x7f0f9c05cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f9affd700 1 --2- 172.21.15.31:0/404114782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c0aca60 0x7f0f9c0ace40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0f8c002f70 tx=0x7f0f8c006eb0).ready entity=mon.0 client_cookie=96779f9db544638f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f99ffb700 1 -- 172.21.15.31:0/404114782 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8c00d570 con 0x7f0f9c0aca60 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f99ffb700 1 -- 172.21.15.31:0/404114782 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c000e90 con 0x7f0f9c0aca60 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.162+0000 7f0f99ffb700 1 -- 172.21.15.31:0/404114782 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8c00d8c0 con 0x7f0f9c0aca60 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.163+0000 7f0fa1925700 1 -- 172.21.15.31:0/404114782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c0aca60 msgr2=0x7f0f9c0ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.163+0000 7f0fa1925700 1 --2- 172.21.15.31:0/404114782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c0aca60 0x7f0f9c0ace40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0f8c002f70 tx=0x7f0f8c006eb0).stop 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.163+0000 7f0fa1925700 1 -- 172.21.15.31:0/404114782 shutdown_connections 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.163+0000 7f0fa1925700 1 --2- 172.21.15.31:0/404114782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c0aca60 0x7f0f9c0ace40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.163+0000 7f0fa1925700 1 --2- 172.21.15.31:0/404114782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0a8af0 0x7f0f9c05cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.163+0000 7f0fa1925700 1 -- 172.21.15.31:0/404114782 >> 172.21.15.31:0/404114782 conn(0x7f0f9c066d50 msgr2=0x7f0f9c067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.163+0000 7f0fa1925700 1 -- 172.21.15.31:0/404114782 shutdown_connections 2024-04-26T07:28:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.163+0000 7f0fa1925700 1 -- 172.21.15.31:0/404114782 wait complete. 2024-04-26T07:28:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.164+0000 7f0fa1925700 1 Processor -- start 2024-04-26T07:28:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.164+0000 7f0fa1925700 1 -- start start 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.164+0000 7f0fa1925700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f9c0a8af0 0x7f0f9c116e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.164+0000 7f0fa1925700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0aca60 0x7f0f9c115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.164+0000 7f0fa1925700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c139510 0x7f0f9c145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.164+0000 7f0fa1925700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c116960 con 0x7f0f9c139510 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.164+0000 7f0fa1925700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1166f0 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.164+0000 7f0fa1925700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c145800 con 0x7f0f9c0aca60 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f9c0a8af0 0x7f0f9c116e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f9c0a8af0 0x7f0f9c116e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44190/0 (socket says 172.21.15.31:44190) 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 -- 172.21.15.31:0/3223013022 learned_addr learned my addr 172.21.15.31:0/3223013022 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9b7fe700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c139510 0x7f0f9c145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9a7fc700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0aca60 0x7f0f9c115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 -- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0aca60 msgr2=0x7f0f9c115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0aca60 0x7f0f9c115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 -- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c139510 msgr2=0x7f0f9c145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c139510 0x7f0f9c145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 -- 172.21.15.31:0/3223013022 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9000b180 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f9affd700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f9c0a8af0 0x7f0f9c116e60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0f8c002f70 tx=0x7f0f8c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f8bfff700 1 -- 172.21.15.31:0/3223013022 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8c0116e0 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f8bfff700 1 -- 172.21.15.31:0/3223013022 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c011840 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c00b1e0 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0f8bfff700 1 -- 172.21.15.31:0/3223013022 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8c011ba0 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.165+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c117350 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.166+0000 7f0f8bfff700 1 -- 172.21.15.31:0/3223013022 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0f8c025030 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.166+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c0ac400 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.166+0000 7f0f8bfff700 1 -- 172.21.15.31:0/3223013022 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0f8c04ba10 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.169+0000 7f0f8bfff700 1 -- 172.21.15.31:0/3223013022 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0f8c01eb90 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.285+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f9c0a6960 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.285+0000 7f0f8bfff700 1 -- 172.21.15.31:0/3223013022 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f8c0230a0 con 0x7f0f9c0a8af0 2024-04-26T07:28:43.286 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-26T07:28:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 >> v1:172.21.15.31:6816/39613 conn(0x7f0f78038e30 legacy=0x7f0f7803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f9c0a8af0 msgr2=0x7f0f9c116e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f9c0a8af0 0x7f0f9c116e60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0f8c002f70 tx=0x7f0f8c015000).stop 2024-04-26T07:28:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 shutdown_connections 2024-04-26T07:28:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f9c139510 0x7f0f9c145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0f9c0a8af0 0x7f0f9c116e60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 --2- 172.21.15.31:0/3223013022 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0f9c0aca60 0x7f0f9c115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 >> 172.21.15.31:0/3223013022 conn(0x7f0f9c066d50 msgr2=0x7f0f9c0a72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 shutdown_connections 2024-04-26T07:28:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.287+0000 7f0fa1925700 1 -- 172.21.15.31:0/3223013022 wait complete. 2024-04-26T07:28:43.297 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T07:28:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.406+0000 7fa62fe5b700 1 Processor -- start 2024-04-26T07:28:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.406+0000 7fa62fe5b700 1 -- start start 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62fe5b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6280acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62fe5b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805d100 0x7fa628139d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62fe5b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280ac450 con 0x7fa62805cd00 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62fe5b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62805c870 con 0x7fa62805d100 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62fe5b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280ac6f0 con 0x7fa6280acb40 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62e3f8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805d100 0x7fa628139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62dbf7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6280acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62d3f6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa62805cd00 0x7fa628139680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32854/0 (socket says 172.21.15.31:32854) 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.407+0000 7fa62d3f6700 1 -- 172.21.15.31:0/3739468571 learned_addr learned my addr 172.21.15.31:0/3739468571 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62cbf5700 1 -- 172.21.15.31:0/3739468571 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958052011 0 0) 0x7fa6280ac450 con 0x7fa62805cd00 2024-04-26T07:28:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62dbf7700 1 -- 172.21.15.31:0/3739468571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805d100 msgr2=0x7fa628139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62dbf7700 1 --2- 172.21.15.31:0/3739468571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805d100 0x7fa628139d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62dbf7700 1 -- 172.21.15.31:0/3739468571 >> v1:172.21.15.31:6789/0 conn(0x7fa62805cd00 legacy=0x7fa628139680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62dbf7700 1 -- 172.21.15.31:0/3739468571 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62805d910 con 0x7fa6280acb40 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62e3f8700 1 --2- 172.21.15.31:0/3739468571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805d100 0x7fa628139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62dbf7700 1 --2- 172.21.15.31:0/3739468571 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6280acf20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa624002f70 tx=0x7fa624006df0).ready entity=mon.2 client_cookie=96a0c6074fd17ab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62cbf5700 1 -- 172.21.15.31:0/3739468571 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62400d570 con 0x7fa6280acb40 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62cbf5700 1 -- 172.21.15.31:0/3739468571 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624000e90 con 0x7fa6280acb40 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62cbf5700 1 -- 172.21.15.31:0/3739468571 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62400d8c0 con 0x7fa6280acb40 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62fe5b700 1 -- 172.21.15.31:0/3739468571 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 msgr2=0x7fa6280acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62fe5b700 1 --2- 172.21.15.31:0/3739468571 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6280acf20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa624002f70 tx=0x7fa624006df0).stop 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62fe5b700 1 -- 172.21.15.31:0/3739468571 shutdown_connections 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62fe5b700 1 --2- 172.21.15.31:0/3739468571 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805d100 0x7fa628139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62fe5b700 1 --2- 172.21.15.31:0/3739468571 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6280acf20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.408+0000 7fa62fe5b700 1 -- 172.21.15.31:0/3739468571 >> 172.21.15.31:0/3739468571 conn(0x7fa628061570 msgr2=0x7fa628066b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.409+0000 7fa62fe5b700 1 -- 172.21.15.31:0/3739468571 shutdown_connections 2024-04-26T07:28:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.409+0000 7fa62fe5b700 1 -- 172.21.15.31:0/3739468571 wait complete. 2024-04-26T07:28:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.409+0000 7fa62fe5b700 1 Processor -- start 2024-04-26T07:28:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.409+0000 7fa62fe5b700 1 -- start start 2024-04-26T07:28:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62fe5b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805cd00 0x7fa628114220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62fe5b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa62805d100 0x7fa628148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62fe5b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6281492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62fe5b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280a2890 con 0x7fa62805d100 2024-04-26T07:28:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62fe5b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281150d0 con 0x7fa62805cd00 2024-04-26T07:28:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62fe5b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280a3a30 con 0x7fa6280acb40 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62dbf7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805cd00 0x7fa628114220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62e3f8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6281492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62dbf7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805cd00 0x7fa628114220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44202/0 (socket says 172.21.15.31:44202) 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62dbf7700 1 -- 172.21.15.31:0/347547726 learned_addr learned my addr 172.21.15.31:0/347547726 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62d3f6700 1 --2- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa62805d100 0x7fa628148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62e3f8700 1 -- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805cd00 msgr2=0x7fa628114220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62e3f8700 1 --2- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805cd00 0x7fa628114220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62e3f8700 1 -- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa62805d100 msgr2=0x7fa628148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62e3f8700 1 --2- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa62805d100 0x7fa628148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.410+0000 7fa62e3f8700 1 -- 172.21.15.31:0/347547726 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620009470 con 0x7fa6280acb40 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.411+0000 7fa62e3f8700 1 --2- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6281492b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa62000c000 tx=0x7fa6200091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.411+0000 7fa61affd700 1 -- 172.21.15.31:0/347547726 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62000ee60 con 0x7fa6280acb40 2024-04-26T07:28:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.411+0000 7fa61affd700 1 -- 172.21.15.31:0/347547726 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62000c850 con 0x7fa6280acb40 2024-04-26T07:28:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.411+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62400b180 con 0x7fa6280acb40 2024-04-26T07:28:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.411+0000 7fa61affd700 1 -- 172.21.15.31:0/347547726 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62000cbb0 con 0x7fa6280acb40 2024-04-26T07:28:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.411+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa628116030 con 0x7fa6280acb40 2024-04-26T07:28:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.412+0000 7fa61affd700 1 -- 172.21.15.31:0/347547726 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa620022070 con 0x7fa6280acb40 2024-04-26T07:28:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.412+0000 7fa61affd700 1 -- 172.21.15.31:0/347547726 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa62004af60 con 0x7fa6280acb40 2024-04-26T07:28:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.412+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa628114c50 con 0x7fa6280acb40 2024-04-26T07:28:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.415+0000 7fa61affd700 1 -- 172.21.15.31:0/347547726 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa628114c50 con 0x7fa6280acb40 2024-04-26T07:28:43.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.531+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa628114c50 con 0x7fa6280acb40 2024-04-26T07:28:43.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.531+0000 7fa61affd700 1 -- 172.21.15.31:0/347547726 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa628114c50 con 0x7fa6280acb40 2024-04-26T07:28:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-26T07:28:43.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.532+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 >> v1:172.21.15.31:6816/39613 conn(0x7fa608038dd0 legacy=0x7fa60803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.532+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 msgr2=0x7fa6281492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.532+0000 7fa62fe5b700 1 --2- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6281492b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa62000c000 tx=0x7fa6200091d0).stop 2024-04-26T07:28:43.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.532+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 shutdown_connections 2024-04-26T07:28:43.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.532+0000 7fa62fe5b700 1 --2- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa6280acb40 0x7fa6281492b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.532+0000 7fa62fe5b700 1 --2- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa62805cd00 0x7fa628114220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.532+0000 7fa62fe5b700 1 --2- 172.21.15.31:0/347547726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa62805d100 0x7fa628148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.532+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 >> 172.21.15.31:0/347547726 conn(0x7fa628061570 msgr2=0x7fa62806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:43.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.533+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 shutdown_connections 2024-04-26T07:28:43.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.533+0000 7fa62fe5b700 1 -- 172.21.15.31:0/347547726 wait complete. 2024-04-26T07:28:43.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:43.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.649+0000 7fec6624a700 1 Processor -- start 2024-04-26T07:28:43.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.649+0000 7fec6624a700 1 -- start start 2024-04-26T07:28:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec6624a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec600648b0 0x7fec60136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec6624a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec60133340 0x7fec601337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec6624a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6006cd70 con 0x7fec6006c990 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec6624a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec60137340 con 0x7fec600648b0 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec6624a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60132eb0 con 0x7fec60133340 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec60133340 0x7fec601337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec600648b0 0x7fec60136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec60133340 0x7fec601337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44216/0 (socket says 172.21.15.31:44216) 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5ffff700 1 -- 172.21.15.31:0/2378848857 learned_addr learned my addr 172.21.15.31:0/2378848857 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec600648b0 0x7fec60136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42412/0 (socket says 172.21.15.31:42412) 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5f7fe700 1 --1- 172.21.15.31:0/2378848857 >> v1:172.21.15.31:6789/0 conn(0x7fec6006c990 0x7fec60136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32866/0 (socket says 172.21.15.31:32866) 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5ffff700 1 -- 172.21.15.31:0/2378848857 >> v2:172.21.15.31:3300/0 conn(0x7fec600648b0 msgr2=0x7fec60136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5ffff700 1 --2- 172.21.15.31:0/2378848857 >> v2:172.21.15.31:3300/0 conn(0x7fec600648b0 0x7fec60136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5ffff700 1 -- 172.21.15.31:0/2378848857 >> v1:172.21.15.31:6789/0 conn(0x7fec6006c990 legacy=0x7fec60136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5ffff700 1 -- 172.21.15.31:0/2378848857 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec60063c00 con 0x7fec60133340 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.650+0000 7fec5ffff700 1 --2- 172.21.15.31:0/2378848857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec60133340 0x7fec601337a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fec600a9bc0 tx=0x7fec58009290).ready entity=mon.1 client_cookie=e27b290e7da00424 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec5e7fc700 1 -- 172.21.15.31:0/2378848857 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5800b860 con 0x7fec60133340 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec5e7fc700 1 -- 172.21.15.31:0/2378848857 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5800b9c0 con 0x7fec60133340 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec5e7fc700 1 -- 172.21.15.31:0/2378848857 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5800bb30 con 0x7fec60133340 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec6624a700 1 -- 172.21.15.31:0/2378848857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec60133340 msgr2=0x7fec601337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec6624a700 1 --2- 172.21.15.31:0/2378848857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec60133340 0x7fec601337a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fec600a9bc0 tx=0x7fec58009290).stop 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec6624a700 1 -- 172.21.15.31:0/2378848857 shutdown_connections 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec6624a700 1 --2- 172.21.15.31:0/2378848857 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec60133340 0x7fec601337a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec6624a700 1 --2- 172.21.15.31:0/2378848857 >> v2:172.21.15.31:3300/0 conn(0x7fec600648b0 0x7fec60136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec6624a700 1 -- 172.21.15.31:0/2378848857 >> 172.21.15.31:0/2378848857 conn(0x7fec60061370 msgr2=0x7fec6006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec6624a700 1 -- 172.21.15.31:0/2378848857 shutdown_connections 2024-04-26T07:28:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.651+0000 7fec6624a700 1 -- 172.21.15.31:0/2378848857 wait complete. 2024-04-26T07:28:43.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.652+0000 7fec6624a700 1 Processor -- start 2024-04-26T07:28:43.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.652+0000 7fec6624a700 1 -- start start 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec6624a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600648b0 0x7fec60144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec6624a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec6006c990 0x7fec601450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec6624a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec60133340 0x7fec601455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec6624a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60145a90 con 0x7fec60133340 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec6624a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60095b00 con 0x7fec600648b0 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec6624a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec60093ec0 con 0x7fec6006c990 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600648b0 0x7fec60144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec60133340 0x7fec601455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec6006c990 0x7fec601450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec60133340 0x7fec601455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42418/0 (socket says 172.21.15.31:42418) 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600648b0 0x7fec60144bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44232/0 (socket says 172.21.15.31:44232) 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5ffff700 1 -- 172.21.15.31:0/1150108233 learned_addr learned my addr 172.21.15.31:0/1150108233 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec6006c990 0x7fec601450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34992/0 (socket says 172.21.15.31:34992) 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5effd700 1 -- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600648b0 msgr2=0x7fec60144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5effd700 1 --2- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600648b0 0x7fec60144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5effd700 1 -- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec60133340 msgr2=0x7fec601455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5effd700 1 --2- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec60133340 0x7fec601455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5effd700 1 -- 172.21.15.31:0/1150108233 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58009530 con 0x7fec6006c990 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5ffff700 1 --2- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec60133340 0x7fec601455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5effd700 1 --2- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec6006c990 0x7fec601450b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fec60095c90 tx=0x7fec50006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5cff9700 1 -- 172.21.15.31:0/1150108233 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5000ec50 con 0x7fec6006c990 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5cff9700 1 -- 172.21.15.31:0/1150108233 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5000edb0 con 0x7fec6006c990 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec5cff9700 1 -- 172.21.15.31:0/1150108233 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec50011640 con 0x7fec6006c990 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.653+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec60094180 con 0x7fec6006c990 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.654+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec60067900 con 0x7fec6006c990 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.654+0000 7fec5cff9700 1 -- 172.21.15.31:0/1150108233 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fec50021070 con 0x7fec6006c990 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.654+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec60095cd0 con 0x7fec6006c990 2024-04-26T07:28:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.655+0000 7fec5cff9700 1 -- 172.21.15.31:0/1150108233 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fec5004d020 con 0x7fec6006c990 2024-04-26T07:28:43.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.658+0000 7fec5cff9700 1 -- 172.21.15.31:0/1150108233 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fec60095cd0 con 0x7fec6006c990 2024-04-26T07:28:43.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.806+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec60095cd0 con 0x7fec6006c990 2024-04-26T07:28:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.806+0000 7fec5cff9700 1 -- 172.21.15.31:0/1150108233 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2320 (secure 0 0 0) 0x7fec60095cd0 con 0x7fec6006c990 2024-04-26T07:28:43.807 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:43.807 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:34.834435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:28:43.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 >> v1:172.21.15.31:6816/39613 conn(0x7fec40038f50 legacy=0x7fec4003b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec6006c990 msgr2=0x7fec601450b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 --2- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec6006c990 0x7fec601450b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fec60095c90 tx=0x7fec50006df0).stop 2024-04-26T07:28:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 shutdown_connections 2024-04-26T07:28:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 --2- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec60133340 0x7fec601455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 --2- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600648b0 0x7fec60144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 --2- 172.21.15.31:0/1150108233 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec6006c990 0x7fec601450b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 >> 172.21.15.31:0/1150108233 conn(0x7fec60061370 msgr2=0x7fec6009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 shutdown_connections 2024-04-26T07:28:43.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.808+0000 7fec6624a700 1 -- 172.21.15.31:0/1150108233 wait complete. 2024-04-26T07:28:43.810 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 9 2024-04-26T07:28:43.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:43.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.927+0000 7fa504837700 1 Processor -- start 2024-04-26T07:28:43.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.927+0000 7fa504837700 1 -- start start 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa504837700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa5001339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa504837700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa50013ea20 0x7fa500140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa504837700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa500133ea0 con 0x7fa5001335d0 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa504837700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5000670c0 con 0x7fa50013ea20 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa504837700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa500066600 con 0x7fa5000679d0 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fdd9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa5001339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fe59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa5001335d0 0x7fa5000a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32882/0 (socket says 172.21.15.31:32882) 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fe59c700 1 -- 172.21.15.31:0/1728958415 learned_addr learned my addr 172.21.15.31:0/1728958415 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fed9d700 1 --2- 172.21.15.31:0/1728958415 >> v2:172.21.15.31:3300/0 conn(0x7fa50013ea20 0x7fa500140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fed9d700 1 -- 172.21.15.31:0/1728958415 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 msgr2=0x7fa5001339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fed9d700 1 --2- 172.21.15.31:0/1728958415 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa5001339b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fed9d700 1 -- 172.21.15.31:0/1728958415 >> v1:172.21.15.31:6789/0 conn(0x7fa5001335d0 legacy=0x7fa5000a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fed9d700 1 -- 172.21.15.31:0/1728958415 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500066de0 con 0x7fa50013ea20 2024-04-26T07:28:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fd59a700 1 -- 172.21.15.31:0/1728958415 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071960472 0 0) 0x7fa500133ea0 con 0x7fa5001335d0 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fdd9b700 1 --2- 172.21.15.31:0/1728958415 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa5001339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fed9d700 1 --2- 172.21.15.31:0/1728958415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa500140e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa4f80032f0 tx=0x7fa4f80091d0).ready entity=mon.0 client_cookie=63fe67e796b72e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fd59a700 1 -- 172.21.15.31:0/1728958415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f800b6c0 con 0x7fa50013ea20 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fd59a700 1 -- 172.21.15.31:0/1728958415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f800b820 con 0x7fa50013ea20 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.928+0000 7fa4fd59a700 1 -- 172.21.15.31:0/1728958415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f800b990 con 0x7fa50013ea20 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.929+0000 7fa504837700 1 -- 172.21.15.31:0/1728958415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 msgr2=0x7fa500140e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.929+0000 7fa504837700 1 --2- 172.21.15.31:0/1728958415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa500140e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa4f80032f0 tx=0x7fa4f80091d0).stop 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.929+0000 7fa504837700 1 -- 172.21.15.31:0/1728958415 shutdown_connections 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.929+0000 7fa504837700 1 --2- 172.21.15.31:0/1728958415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa500140e10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.929+0000 7fa504837700 1 --2- 172.21.15.31:0/1728958415 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa5001339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.929+0000 7fa504837700 1 -- 172.21.15.31:0/1728958415 >> 172.21.15.31:0/1728958415 conn(0x7fa500060ee0 msgr2=0x7fa5000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.929+0000 7fa504837700 1 -- 172.21.15.31:0/1728958415 shutdown_connections 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.929+0000 7fa504837700 1 -- 172.21.15.31:0/1728958415 wait complete. 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa504837700 1 Processor -- start 2024-04-26T07:28:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa504837700 1 -- start start 2024-04-26T07:28:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa504837700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa500137dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa504837700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5001335d0 0x7fa50009e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa504837700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa50009e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa504837700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000a7c90 con 0x7fa50013ea20 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa504837700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa500137990 con 0x7fa5001335d0 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa504837700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50009df30 con 0x7fa5000679d0 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa4fe59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa500137dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa4fed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa50009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa4fed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa50009e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42424/0 (socket says 172.21.15.31:42424) 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa4fed9d700 1 -- 172.21.15.31:0/1394606944 learned_addr learned my addr 172.21.15.31:0/1394606944 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.930+0000 7fa4fdd9b700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5001335d0 0x7fa50009e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4fed9d700 1 -- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 msgr2=0x7fa500137dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4fed9d700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa500137dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4fed9d700 1 -- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5001335d0 msgr2=0x7fa50009e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4fed9d700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5001335d0 0x7fa50009e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4fed9d700 1 -- 172.21.15.31:0/1394606944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f400b180 con 0x7fa50013ea20 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4fe59c700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa500137dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4fdd9b700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5001335d0 0x7fa50009e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4fed9d700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa50009e870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa4f80032f0 tx=0x7fa4f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4ef7fe700 1 -- 172.21.15.31:0/1394606944 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f800b6c0 con 0x7fa50013ea20 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4ef7fe700 1 -- 172.21.15.31:0/1394606944 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8021630 con 0x7fa50013ea20 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f8009470 con 0x7fa50013ea20 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa4ef7fe700 1 -- 172.21.15.31:0/1394606944 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f8021990 con 0x7fa50013ea20 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.931+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50009ed60 con 0x7fa50013ea20 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.932+0000 7fa4ef7fe700 1 -- 172.21.15.31:0/1394606944 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa4f8027020 con 0x7fa50013ea20 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.932+0000 7fa4ef7fe700 1 -- 172.21.15.31:0/1394606944 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa4f804bcf0 con 0x7fa50013ea20 2024-04-26T07:28:43.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.932+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa500065ba0 con 0x7fa50013ea20 2024-04-26T07:28:43.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:43.935+0000 7fa4ef7fe700 1 -- 172.21.15.31:0/1394606944 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa4f8015030 con 0x7fa50013ea20 2024-04-26T07:28:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.054+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa50006bbc0 con 0x7fa50013ea20 2024-04-26T07:28:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.055+0000 7fa4ef7fe700 1 -- 172.21.15.31:0/1394606944 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7fa4f8021d20 con 0x7fa50013ea20 2024-04-26T07:28:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:44.056 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:32.133218+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:44.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.056+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 >> v1:172.21.15.31:6816/39613 conn(0x7fa4dc038da0 legacy=0x7fa4dc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.056+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 msgr2=0x7fa50009e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.056+0000 7fa504837700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa50009e870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa4f80032f0 tx=0x7fa4f8016000).stop 2024-04-26T07:28:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.056+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 shutdown_connections 2024-04-26T07:28:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.056+0000 7fa504837700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5000679d0 0x7fa500137dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.056+0000 7fa504837700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa50013ea20 0x7fa50009e870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.056+0000 7fa504837700 1 --2- 172.21.15.31:0/1394606944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5001335d0 0x7fa50009e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.056+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 >> 172.21.15.31:0/1394606944 conn(0x7fa500060ee0 msgr2=0x7fa5000a8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.057+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 shutdown_connections 2024-04-26T07:28:44.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.057+0000 7fa504837700 1 -- 172.21.15.31:0/1394606944 wait complete. 2024-04-26T07:28:44.068 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:44.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.174+0000 7fd96c582700 1 Processor -- start 2024-04-26T07:28:44.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.174+0000 7fd96c582700 1 -- start start 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96c582700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd96406c990 0x7fd964136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96c582700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd964136c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96c582700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96406cd70 con 0x7fd964133340 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96c582700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd964132eb0 con 0x7fd96406c990 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96c582700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964063c00 con 0x7fd9640648b0 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96a31e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd96406c990 0x7fd964136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd969b1d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd964136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd969b1d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd964136c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44256/0 (socket says 172.21.15.31:44256) 2024-04-26T07:28:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96a31e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd96406c990 0x7fd964136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42428/0 (socket says 172.21.15.31:42428) 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd969b1d700 1 -- 172.21.15.31:0/600402455 learned_addr learned my addr 172.21.15.31:0/600402455 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96ab1f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd964133340 0x7fd9641337a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32896/0 (socket says 172.21.15.31:32896) 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd969b1d700 1 -- 172.21.15.31:0/600402455 >> v2:172.21.15.31:3300/0 conn(0x7fd96406c990 msgr2=0x7fd964136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd969b1d700 1 --2- 172.21.15.31:0/600402455 >> v2:172.21.15.31:3300/0 conn(0x7fd96406c990 0x7fd964136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd969b1d700 1 -- 172.21.15.31:0/600402455 >> v1:172.21.15.31:6789/0 conn(0x7fd964133340 legacy=0x7fd9641337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd969b1d700 1 -- 172.21.15.31:0/600402455 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9641330a0 con 0x7fd9640648b0 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96a31e700 1 --2- 172.21.15.31:0/600402455 >> v2:172.21.15.31:3300/0 conn(0x7fd96406c990 0x7fd964136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd969b1d700 1 --2- 172.21.15.31:0/600402455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd964136c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd9640a9bc0 tx=0x7fd954006d70).ready entity=mon.1 client_cookie=2a73bd6c7f63f5b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96931c700 1 -- 172.21.15.31:0/600402455 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd954012070 con 0x7fd9640648b0 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96931c700 1 -- 172.21.15.31:0/600402455 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954000e90 con 0x7fd9640648b0 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.175+0000 7fd96931c700 1 -- 172.21.15.31:0/600402455 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95400fbf0 con 0x7fd9640648b0 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.176+0000 7fd96c582700 1 -- 172.21.15.31:0/600402455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 msgr2=0x7fd964136c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.176+0000 7fd96c582700 1 --2- 172.21.15.31:0/600402455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd964136c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd9640a9bc0 tx=0x7fd954006d70).stop 2024-04-26T07:28:44.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.176+0000 7fd96c582700 1 -- 172.21.15.31:0/600402455 shutdown_connections 2024-04-26T07:28:44.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.176+0000 7fd96c582700 1 --2- 172.21.15.31:0/600402455 >> v2:172.21.15.31:3300/0 conn(0x7fd96406c990 0x7fd964136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.176+0000 7fd96c582700 1 --2- 172.21.15.31:0/600402455 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd964136c30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.176+0000 7fd96c582700 1 -- 172.21.15.31:0/600402455 >> 172.21.15.31:0/600402455 conn(0x7fd964061370 msgr2=0x7fd96406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.176+0000 7fd96c582700 1 -- 172.21.15.31:0/600402455 shutdown_connections 2024-04-26T07:28:44.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.176+0000 7fd96c582700 1 -- 172.21.15.31:0/600402455 wait complete. 2024-04-26T07:28:44.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.177+0000 7fd96c582700 1 Processor -- start 2024-04-26T07:28:44.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.177+0000 7fd96c582700 1 -- start start 2024-04-26T07:28:44.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96c582700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd9640956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96c582700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd96406c990 0x7fd9640968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96c582700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964133340 0x7fd9640974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96c582700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964095b90 con 0x7fd964133340 2024-04-26T07:28:44.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96c582700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964130e30 con 0x7fd9640648b0 2024-04-26T07:28:44.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96c582700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641310d0 con 0x7fd96406c990 2024-04-26T07:28:44.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd9640956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd9640956a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44258/0 (socket says 172.21.15.31:44258) 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96ab1f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964133340 0x7fd9640974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 -- 172.21.15.31:0/1982840389 learned_addr learned my addr 172.21.15.31:0/1982840389 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd969b1d700 1 --2- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd96406c990 0x7fd9640968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 -- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd96406c990 msgr2=0x7fd9640968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 --2- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd96406c990 0x7fd9640968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 -- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964133340 msgr2=0x7fd9640974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 --2- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964133340 0x7fd9640974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 -- 172.21.15.31:0/1982840389 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96000b180 con 0x7fd9640648b0 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.178+0000 7fd96a31e700 1 --2- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd9640956a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd96000c000 tx=0x7fd960006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.179+0000 7fd9537fe700 1 -- 172.21.15.31:0/1982840389 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd96000c5f0 con 0x7fd9640648b0 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.179+0000 7fd9537fe700 1 -- 172.21.15.31:0/1982840389 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000c750 con 0x7fd9640648b0 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.179+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95400d660 con 0x7fd9640648b0 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.179+0000 7fd9537fe700 1 -- 172.21.15.31:0/1982840389 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd96000cab0 con 0x7fd9640648b0 2024-04-26T07:28:44.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.179+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964095d80 con 0x7fd9640648b0 2024-04-26T07:28:44.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.179+0000 7fd9537fe700 1 -- 172.21.15.31:0/1982840389 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd96000cc10 con 0x7fd9640648b0 2024-04-26T07:28:44.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.180+0000 7fd9537fe700 1 -- 172.21.15.31:0/1982840389 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd96004ad90 con 0x7fd9640648b0 2024-04-26T07:28:44.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.180+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96406bbc0 con 0x7fd9640648b0 2024-04-26T07:28:44.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.183+0000 7fd9537fe700 1 -- 172.21.15.31:0/1982840389 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd9600336c0 con 0x7fd9640648b0 2024-04-26T07:28:44.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.331+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd964064dd0 con 0x7fd9640648b0 2024-04-26T07:28:44.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.332+0000 7fd9537fe700 1 -- 172.21.15.31:0/1982840389 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2320 (secure 0 0 0) 0x7fd9600332b0 con 0x7fd9640648b0 2024-04-26T07:28:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:44.332 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:34.834435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 >> v1:172.21.15.31:6816/39613 conn(0x7fd944038f50 legacy=0x7fd94403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 msgr2=0x7fd9640956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 --2- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd9640956a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd96000c000 tx=0x7fd960006df0).stop 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 shutdown_connections 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 --2- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd964133340 0x7fd9640974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 --2- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9640648b0 0x7fd9640956a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 --2- 172.21.15.31:0/1982840389 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd96406c990 0x7fd9640968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 >> 172.21.15.31:0/1982840389 conn(0x7fd964061370 msgr2=0x7fd96409af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 shutdown_connections 2024-04-26T07:28:44.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.333+0000 7fd96c582700 1 -- 172.21.15.31:0/1982840389 wait complete. 2024-04-26T07:28:44.335 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 9 2024-04-26T07:28:44.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:34.834435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:28:44.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-04-26T07:28:44.647 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T07:28:44.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.756+0000 7fc8f2f5c700 1 Processor -- start 2024-04-26T07:28:44.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.756+0000 7fc8f2f5c700 1 -- start start 2024-04-26T07:28:44.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.756+0000 7fc8f2f5c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.756+0000 7fc8f2f5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f2f5c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec0970a0 con 0x7fc8ec06c7d0 2024-04-26T07:28:44.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f2f5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec133c10 con 0x7fc8ec05c080 2024-04-26T07:28:44.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f2f5c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec096810 con 0x7fc8ec1360f0 2024-04-26T07:28:44.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f14f9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f0cf8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc8ec06c7d0 0x7fc8ec05b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32900/0 (socket says 172.21.15.31:32900) 2024-04-26T07:28:44.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8ebfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f0cf8700 1 -- 172.21.15.31:0/3164810133 learned_addr learned my addr 172.21.15.31:0/3164810133 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8eb7fe700 1 -- 172.21.15.31:0/3164810133 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441638534 0 0) 0x7fc8ec0970a0 con 0x7fc8ec06c7d0 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8eb7fe700 1 -- 172.21.15.31:0/3164810133 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d0003260 con 0x7fc8ec06c7d0 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f14f9700 1 -- 172.21.15.31:0/3164810133 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 msgr2=0x7fc8ec096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/3164810133 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f14f9700 1 -- 172.21.15.31:0/3164810133 >> v1:172.21.15.31:6789/0 conn(0x7fc8ec06c7d0 legacy=0x7fc8ec05b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f14f9700 1 -- 172.21.15.31:0/3164810133 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec1364d0 con 0x7fc8ec05c080 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/3164810133 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/3164810133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec141a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc8e40032f0 tx=0x7fc8e40091d0).ready entity=mon.1 client_cookie=ea4e38ee41c20145 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8eb7fe700 1 -- 172.21.15.31:0/3164810133 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e400b640 con 0x7fc8ec05c080 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8eb7fe700 1 -- 172.21.15.31:0/3164810133 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400b7a0 con 0x7fc8ec05c080 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.757+0000 7fc8eb7fe700 1 -- 172.21.15.31:0/3164810133 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e400b910 con 0x7fc8ec05c080 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.758+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/3164810133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 msgr2=0x7fc8ec141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.758+0000 7fc8f2f5c700 1 --2- 172.21.15.31:0/3164810133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec141a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc8e40032f0 tx=0x7fc8e40091d0).stop 2024-04-26T07:28:44.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.758+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/3164810133 shutdown_connections 2024-04-26T07:28:44.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.758+0000 7fc8f2f5c700 1 --2- 172.21.15.31:0/3164810133 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec141a50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.758+0000 7fc8f2f5c700 1 --2- 172.21.15.31:0/3164810133 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.758+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/3164810133 >> 172.21.15.31:0/3164810133 conn(0x7fc8ec061370 msgr2=0x7fc8ec06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.758+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/3164810133 shutdown_connections 2024-04-26T07:28:44.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.758+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/3164810133 wait complete. 2024-04-26T07:28:44.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.759+0000 7fc8f2f5c700 1 Processor -- start 2024-04-26T07:28:44.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.759+0000 7fc8f2f5c700 1 -- start start 2024-04-26T07:28:44.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.759+0000 7fc8f2f5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec063d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.759+0000 7fc8f2f5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8ec06c7d0 0x7fc8ec064c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f2f5c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec062000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f2f5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec065890 con 0x7fc8ec06c7d0 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f2f5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec064410 con 0x7fc8ec05c080 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f2f5c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec064230 con 0x7fc8ec1360f0 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8ec06c7d0 0x7fc8ec064c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec063d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f14f9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec062000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8ec06c7d0 0x7fc8ec064c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42456/0 (socket says 172.21.15.31:42456) 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8ebfff700 1 -- 172.21.15.31:0/2500330458 learned_addr learned my addr 172.21.15.31:0/2500330458 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f14f9700 1 -- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 msgr2=0x7fc8ec063d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec063d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f14f9700 1 -- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8ec06c7d0 msgr2=0x7fc8ec064c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8ec06c7d0 0x7fc8ec064c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f14f9700 1 -- 172.21.15.31:0/2500330458 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d800b180 con 0x7fc8ec1360f0 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8ec06c7d0 0x7fc8ec064c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f0cf8700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec063d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec062000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc8ec067080 tx=0x7fc8e4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8e9ffb700 1 -- 172.21.15.31:0/2500330458 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e400b640 con 0x7fc8ec1360f0 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8e9ffb700 1 -- 172.21.15.31:0/2500330458 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e4011cb0 con 0x7fc8ec1360f0 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8e9ffb700 1 -- 172.21.15.31:0/2500330458 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e401f5e0 con 0x7fc8ec1360f0 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/2500330458 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e4009470 con 0x7fc8ec1360f0 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.760+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/2500330458 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec139e70 con 0x7fc8ec1360f0 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.761+0000 7fc8e9ffb700 1 -- 172.21.15.31:0/2500330458 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc8e400f070 con 0x7fc8ec1360f0 2024-04-26T07:28:44.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.761+0000 7fc8e9ffb700 1 -- 172.21.15.31:0/2500330458 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc8e404acf0 con 0x7fc8ec1360f0 2024-04-26T07:28:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.764+0000 7fc9049e3b80 1 Processor -- start 2024-04-26T07:28:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc9049e3b80 1 -- start start 2024-04-26T07:28:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe3827a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe38349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3839a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbe37d5a10 con 0x55dbe38345b0 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbe377ae10 con 0x55dbe38341d0 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dbe374b8b0 con 0x55dbe3839590 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe3827a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe3827a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44280/0 (socket says 172.21.15.31:44280) 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f14f9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3839a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f0cf8700 1 -- 172.21.15.31:0/1260989442 learned_addr learned my addr 172.21.15.31:0/1260989442 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe38349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f14f9700 1 -- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 msgr2=0x55dbe3827a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe3827a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f14f9700 1 -- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 msgr2=0x55dbe38349b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe38349b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.765+0000 7fc8f14f9700 1 -- 172.21.15.31:0/1260989442 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbe37e1e20 con 0x55dbe3839590 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc8f0cf8700 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe3827a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe38349b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T07:28:44.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3839a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc8e401af90 tx=0x7fc8e401d000).ready entity=mon.2 client_cookie=b1e2b7a56f8589ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/1260989442 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e402f070 con 0x55dbe3839590 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/1260989442 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e4014170 con 0x55dbe3839590 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/1260989442 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e4011ea0 con 0x55dbe3839590 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 msgr2=0x55dbe3839a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3839a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc8e401af90 tx=0x7fc8e401d000).stop 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1260989442 shutdown_connections 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3839a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe3827a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/1260989442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe38349b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1260989442 >> 172.21.15.31:0/1260989442 conn(0x55dbe37d3970 msgr2=0x55dbe372d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1260989442 shutdown_connections 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.766+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1260989442 wait complete. 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.767+0000 7fc9049e3b80 1 -- start start 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.767+0000 7fc9049e3b80 1 Processor -- start 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38341d0 0x55dbe382c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe38428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3842de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbe375f180 con 0x55dbe38341d0 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbe373f7f0 con 0x55dbe38345b0 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dbe372f710 con 0x55dbe3839590 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc9049e3b80 10 client.0 ll_register_callbacks cb 0x55dbe3754570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38341d0 0x55dbe382c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38341d0 0x55dbe382c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42464/0 (socket says 172.21.15.31:42464) 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8ebfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe38428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 -- 172.21.15.31:0/2190640990 learned_addr learned my addr 172.21.15.31:0/2190640990 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3842de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 -- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 msgr2=0x55dbe3842de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3842de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 -- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 msgr2=0x55dbe38428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe38428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 -- 172.21.15.31:0/2190640990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d0003260 con 0x55dbe38341d0 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe38428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8f0cf8700 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38341d0 0x55dbe382c7f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x55dbe382c660 tx=0x7fc8e0009040).ready entity=mon.0 client_cookie=1b87687a3f9b40cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-26T07:28:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8cb7fe700 1 -- 172.21.15.31:0/2190640990 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e0014ea0 con 0x55dbe38341d0 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc8cb7fe700 1 -- 172.21.15.31:0/2190640990 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc8e0012750 con 0x55dbe38341d0 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.768+0000 7fc9049e3b80 1 -- 172.21.15.31:0/2190640990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dbe36d60c0 con 0x55dbe38341d0 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc8cb7fe700 1 -- 172.21.15.31:0/2190640990 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8e0012910 con 0x55dbe38341d0 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc9049e3b80 10 client.4671 fetch_fsmap learned FSMap version 9 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc9049e3b80 1 -- 172.21.15.31:0/2190640990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7fc8ec139e70 con 0x55dbe38341d0 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc8cb7fe700 1 -- 172.21.15.31:0/2190640990 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dbe36d60c0 con 0x55dbe38341d0 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc8cb7fe700 1 -- 172.21.15.31:0/2190640990 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7fc8e0012a70 con 0x55dbe38341d0 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc9049e3b80 10 client.4671 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc9049e3b80 10 client.4671 resolve_mds: resolved ID 'a' to GID 4204 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc9049e3b80 20 client.4671 populate_metadata read hostname 'smithi031' 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc9049e3b80 4 client.4671 mds_command: new command op to 4204 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc9049e3b80 1 -- 172.21.15.31:0/2190640990 --> v1:172.21.15.31:6818/1834150302 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dbe3755230 con 0x55dbe383f3f0 2024-04-26T07:28:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.769+0000 7fc8cb7fe700 10 client.4671 ms_handle_connect on v1:172.21.15.31:6818/1834150302 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc8cb7fe700 1 -- 172.21.15.31:0/2190640990 <== mds.1 v1:172.21.15.31:6818/1834150302 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55dbe3755230 con 0x55dbe383f3f0 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc8cb7fe700 10 client.4671 handle_command_reply: tid=0 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 client.4671 shutdown 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 -- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38341d0 msgr2=0x55dbe382c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38341d0 0x55dbe382c7f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x55dbe382c660 tx=0x7fc8e0009040).stop 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 -- 172.21.15.31:0/2190640990 shutdown_connections 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe3842de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc8cb7fe700 0 client.4671 ms_handle_reset on v1:172.21.15.31:6818/1834150302 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38341d0 0x55dbe382c7f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/2190640990 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe38428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 -- 172.21.15.31:0/2190640990 >> 172.21.15.31:0/2190640990 conn(0x55dbe37d3970 msgr2=0x55dbe372d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 -- 172.21.15.31:0/2190640990 shutdown_connections 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 1 -- 172.21.15.31:0/2190640990 wait complete. 2024-04-26T07:28:44.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.770+0000 7fc9049e3b80 20 client.4671 trim_cache size 0 max 16384 2024-04-26T07:28:44.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.786+0000 7fc9049e3b80 1 Processor -- start 2024-04-26T07:28:44.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.786+0000 7fc9049e3b80 1 -- start start 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe38341d0 0x55dbe382ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe383f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe3839590 0x55dbe382a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbe38423e0 con 0x55dbe3839590 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbe372c700 con 0x55dbe38345b0 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dbe3755230 con 0x55dbe38341d0 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe38341d0 0x55dbe382ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8ebfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe383f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe38341d0 0x55dbe382ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:35078/0 (socket says 172.21.15.31:35078) 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8f0cf8700 1 -- 172.21.15.31:0/1167629405 learned_addr learned my addr 172.21.15.31:0/1167629405 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe3839590 0x55dbe382a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8ebfff700 1 -- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe38341d0 msgr2=0x55dbe382ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe38341d0 0x55dbe382ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8ebfff700 1 -- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe3839590 msgr2=0x55dbe382a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe3839590 0x55dbe382a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8ebfff700 1 -- 172.21.15.31:0/1167629405 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbe374eae0 con 0x55dbe38345b0 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe3839590 0x55dbe382a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.787+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe383f7d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x55dbe3747980 tx=0x7fc8d8006df0).ready entity=mon.1 client_cookie=93d79ac810897901 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc8d5ffb700 1 -- 172.21.15.31:0/1167629405 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d8019660 con 0x55dbe38345b0 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc8d5ffb700 1 -- 172.21.15.31:0/1167629405 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d80197c0 con 0x55dbe38345b0 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc8d5ffb700 1 -- 172.21.15.31:0/1167629405 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d8019b20 con 0x55dbe38345b0 2024-04-26T07:28:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 msgr2=0x55dbe383f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe383f7d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x55dbe3747980 tx=0x7fc8d8006df0).stop 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1167629405 shutdown_connections 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe38341d0 0x55dbe382ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe3839590 0x55dbe382a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/1167629405 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38345b0 0x55dbe383f7d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1167629405 >> 172.21.15.31:0/1167629405 conn(0x55dbe37d3970 msgr2=0x55dbe3833aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1167629405 shutdown_connections 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.788+0000 7fc9049e3b80 1 -- 172.21.15.31:0/1167629405 wait complete. 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.789+0000 7fc9049e3b80 1 -- start start 2024-04-26T07:28:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.789+0000 7fc9049e3b80 1 Processor -- start 2024-04-26T07:28:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe38355c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe388e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc9049e3b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe388ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbe3829a00 con 0x55dbe38345b0 2024-04-26T07:28:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dbe3842cd0 con 0x55dbe38341d0 2024-04-26T07:28:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc9049e3b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dbe3842f90 con 0x55dbe3839590 2024-04-26T07:28:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc9049e3b80 10 client.0 ll_register_callbacks cb 0x55dbe3808530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T07:28:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe38355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe388e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f0cf8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe38355c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44310/0 (socket says 172.21.15.31:44310) 2024-04-26T07:28:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f14f9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe388ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f0cf8700 1 -- 172.21.15.31:0/3496446449 learned_addr learned my addr 172.21.15.31:0/3496446449 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe388e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42480/0 (socket says 172.21.15.31:42480) 2024-04-26T07:28:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f14f9700 1 -- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 msgr2=0x55dbe38355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe38355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f14f9700 1 -- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 msgr2=0x55dbe388e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe388e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f14f9700 1 -- 172.21.15.31:0/3496446449 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbe37e1e20 con 0x55dbe3839590 2024-04-26T07:28:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe388e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8f14f9700 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe388ea30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x55dbe383bcd0 tx=0x7fc8e402f000).ready entity=mon.2 client_cookie=98cbb88d6a5629ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.790+0000 7fc8d4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.31:3302/0 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc8d4ff9700 1 -- 172.21.15.31:0/3496446449 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e403a070 con 0x55dbe3839590 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc8d4ff9700 1 -- 172.21.15.31:0/3496446449 <== mon.2 v2:172.21.15.31:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc8e40136f0 con 0x55dbe3839590 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc9049e3b80 1 -- 172.21.15.31:0/3496446449 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8e4014170 con 0x55dbe3839590 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc8d4ff9700 1 -- 172.21.15.31:0/3496446449 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8e40138b0 con 0x55dbe3839590 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc9049e3b80 10 client.4496 fetch_fsmap learned FSMap version 9 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc9049e3b80 1 -- 172.21.15.31:0/3496446449 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7fc8d8013690 con 0x55dbe3839590 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc8d4ff9700 1 -- 172.21.15.31:0/3496446449 <== mon.2 v2:172.21.15.31:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e4014170 con 0x55dbe3839590 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc8d4ff9700 1 -- 172.21.15.31:0/3496446449 <== mon.2 v2:172.21.15.31:3302/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7fc8e4005a70 con 0x55dbe3839590 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc9049e3b80 10 client.4496 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc9049e3b80 10 client.4496 resolve_mds: resolved ID 'a' to GID 4204 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc9049e3b80 20 client.4496 populate_metadata read hostname 'smithi031' 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc9049e3b80 4 client.4496 mds_command: new command op to 4204 tid=0[{"prefix": "status"}] 2024-04-26T07:28:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc9049e3b80 1 -- 172.21.15.31:0/3496446449 --> v1:172.21.15.31:6818/1834150302 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dbe374d570 con 0x55dbe3828300 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.791+0000 7fc8d4ff9700 10 client.4496 ms_handle_connect on v1:172.21.15.31:6818/1834150302 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc8d4ff9700 1 -- 172.21.15.31:0/3496446449 <== mds.1 v1:172.21.15.31:6818/1834150302 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+305 (unknown 0 0 2419330401) 0x55dbe374d570 con 0x55dbe3828300 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc8d4ff9700 10 client.4496 handle_command_reply: tid=0 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 client.4496 shutdown 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 -- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 msgr2=0x55dbe388ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe388ea30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x55dbe383bcd0 tx=0x7fc8e402f000).stop 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 -- 172.21.15.31:0/3496446449 shutdown_connections 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55dbe3839590 0x55dbe388ea30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55dbe38341d0 0x55dbe38355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 --2- 172.21.15.31:0/3496446449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dbe38345b0 0x55dbe388e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc8d4ff9700 0 client.4496 ms_handle_reset on v1:172.21.15.31:6818/1834150302 2024-04-26T07:28:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 -- 172.21.15.31:0/3496446449 >> 172.21.15.31:0/3496446449 conn(0x55dbe37d3970 msgr2=0x55dbe383f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 -- 172.21.15.31:0/3496446449 shutdown_connections 2024-04-26T07:28:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 1 -- 172.21.15.31:0/3496446449 wait complete. 2024-04-26T07:28:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc9049e3b80 20 client.4496 trim_cache size 0 max 16384 2024-04-26T07:28:44.801 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-26T07:28:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "1efcad47-d196-4e33-a2f1-15c92eeb84f0", 2024-04-26T07:28:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 1, 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4204, 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.957581515999999, 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 9, 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 18, 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 18, 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 22.662219491999998 2024-04-26T07:28:44.802 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/2500330458 >> v1:172.21.15.31:6816/39613 conn(0x7fc8cc038f50 legacy=0x7fc8cc03b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 msgr2=0x7fc8ec062000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.792+0000 7fc8f2f5c700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec062000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc8ec067080 tx=0x7fc8e4016000).stop 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.793+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/2500330458 shutdown_connections 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.793+0000 7fc8f2f5c700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc8ec1360f0 0x7fc8ec062000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.793+0000 7fc8f2f5c700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8ec05c080 0x7fc8ec063d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.793+0000 7fc8f2f5c700 1 --2- 172.21.15.31:0/2500330458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8ec06c7d0 0x7fc8ec064c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.793+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/2500330458 >> 172.21.15.31:0/2500330458 conn(0x7fc8ec061370 msgr2=0x7fc8ec09ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.793+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/2500330458 shutdown_connections 2024-04-26T07:28:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.793+0000 7fc8f2f5c700 1 -- 172.21.15.31:0/2500330458 wait complete. 2024-04-26T07:28:44.805 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T07:28:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.913+0000 7f823a750700 1 Processor -- start 2024-04-26T07:28:44.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.913+0000 7f823a750700 1 -- start start 2024-04-26T07:28:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f823a750700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8234067500 0x7f823409a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f823a750700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409c070 0x7f8234136d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f823a750700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823409b670 con 0x7f823409bc70 2024-04-26T07:28:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f823a750700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82341361b0 con 0x7f8234067500 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f823a750700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f823409b400 con 0x7f823409c070 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f8238ced700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409c070 0x7f8234136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f8233fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8234067500 0x7f823409a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f8233fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8234067500 0x7f823409a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44314/0 (socket says 172.21.15.31:44314) 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f8238ced700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409c070 0x7f8234136d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:35094/0 (socket says 172.21.15.31:35094) 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f8233fff700 1 -- 172.21.15.31:0/4201655394 learned_addr learned my addr 172.21.15.31:0/4201655394 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f82337fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f823409bc70 0x7f8234136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32906/0 (socket says 172.21.15.31:32906) 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8233fff700 1 -- 172.21.15.31:0/4201655394 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409c070 msgr2=0x7f8234136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.914+0000 7f8232ffd700 1 -- 172.21.15.31:0/4201655394 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307574602 0 0) 0x7f823409b670 con 0x7f823409bc70 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8233fff700 1 --2- 172.21.15.31:0/4201655394 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409c070 0x7f8234136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8233fff700 1 -- 172.21.15.31:0/4201655394 >> v1:172.21.15.31:6789/0 conn(0x7f823409bc70 legacy=0x7f8234136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8233fff700 1 -- 172.21.15.31:0/4201655394 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82341363a0 con 0x7f8234067500 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8238ced700 1 --2- 172.21.15.31:0/4201655394 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409c070 0x7f8234136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8233fff700 1 --2- 172.21.15.31:0/4201655394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8234067500 0x7f823409a8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f821c002f70 tx=0x7f821c006eb0).ready entity=mon.1 client_cookie=b42c74b9d497b1c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8232ffd700 1 -- 172.21.15.31:0/4201655394 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821c00d570 con 0x7f8234067500 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8232ffd700 1 -- 172.21.15.31:0/4201655394 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c000e90 con 0x7f8234067500 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f8232ffd700 1 -- 172.21.15.31:0/4201655394 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821c00d910 con 0x7f8234067500 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f823a750700 1 -- 172.21.15.31:0/4201655394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8234067500 msgr2=0x7f823409a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f823a750700 1 --2- 172.21.15.31:0/4201655394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8234067500 0x7f823409a8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f821c002f70 tx=0x7f821c006eb0).stop 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f823a750700 1 -- 172.21.15.31:0/4201655394 shutdown_connections 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f823a750700 1 --2- 172.21.15.31:0/4201655394 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409c070 0x7f8234136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f823a750700 1 --2- 172.21.15.31:0/4201655394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8234067500 0x7f823409a8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f823a750700 1 -- 172.21.15.31:0/4201655394 >> 172.21.15.31:0/4201655394 conn(0x7f823405cfb0 msgr2=0x7f8234062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f823a750700 1 -- 172.21.15.31:0/4201655394 shutdown_connections 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.915+0000 7f823a750700 1 -- 172.21.15.31:0/4201655394 wait complete. 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.916+0000 7f823a750700 1 Processor -- start 2024-04-26T07:28:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.916+0000 7f823a750700 1 -- start start 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f823a750700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8234067500 0x7f8234093920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f823a750700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409bc70 0x7f82341490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f823a750700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823409c070 0x7f82341495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f823a750700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823413a4c0 con 0x7f8234067500 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f823a750700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8234095a80 con 0x7f823409c070 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f823a750700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8234091f10 con 0x7f823409bc70 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f82337fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409bc70 0x7f82341490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f8238ced700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823409c070 0x7f82341495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f82337fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409bc70 0x7f82341490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:35110/0 (socket says 172.21.15.31:35110) 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f8238ced700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823409c070 0x7f82341495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44316/0 (socket says 172.21.15.31:44316) 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f82337fe700 1 -- 172.21.15.31:0/3631452200 learned_addr learned my addr 172.21.15.31:0/3631452200 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f8233fff700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8234067500 0x7f8234093920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f82337fe700 1 -- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823409c070 msgr2=0x7f82341495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f82337fe700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823409c070 0x7f82341495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f82337fe700 1 -- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8234067500 msgr2=0x7f8234093920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f82337fe700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8234067500 0x7f8234093920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f82337fe700 1 -- 172.21.15.31:0/3631452200 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c009470 con 0x7f823409bc70 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f8233fff700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8234067500 0x7f8234093920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.917+0000 7f8238ced700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823409c070 0x7f82341495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.918+0000 7f82337fe700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409bc70 0x7f82341490e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f823413c700 tx=0x7f8224007a30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.918+0000 7f82317fa700 1 -- 172.21.15.31:0/3631452200 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f822400ce40 con 0x7f823409bc70 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.918+0000 7f82317fa700 1 -- 172.21.15.31:0/3631452200 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82240072e0 con 0x7f823409bc70 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.918+0000 7f823a750700 1 -- 172.21.15.31:0/3631452200 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c00b1e0 con 0x7f823409bc70 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.918+0000 7f82317fa700 1 -- 172.21.15.31:0/3631452200 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8224005740 con 0x7f823409bc70 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.918+0000 7f823a750700 1 -- 172.21.15.31:0/3631452200 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8234094250 con 0x7f823409bc70 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.919+0000 7f82317fa700 1 -- 172.21.15.31:0/3631452200 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8224010070 con 0x7f823409bc70 2024-04-26T07:28:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.919+0000 7f82317fa700 1 -- 172.21.15.31:0/3631452200 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8224049ff0 con 0x7f823409bc70 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.922+0000 7f824c1d7b80 1 Processor -- start 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.922+0000 7f824c1d7b80 1 -- start start 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f79a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f865b0 0x55e168f869b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f8ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e168f27a10 con 0x55e168f865b0 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e168ecce10 con 0x55e168f8b590 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e168e9d8b0 con 0x55e168f861d0 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8233fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f79a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f8ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f82337fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f865b0 0x55e168f869b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f8ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44332/0 (socket says 172.21.15.31:44332) 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8233fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f79a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:35124/0 (socket says 172.21.15.31:35124) 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 -- 172.21.15.31:0/345005705 learned_addr learned my addr 172.21.15.31:0/345005705 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 -- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 msgr2=0x55e168f79a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 --2- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f79a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 -- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f865b0 msgr2=0x55e168f869b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 --2- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f865b0 0x55e168f869b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 -- 172.21.15.31:0/345005705 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e168f33e20 con 0x55e168f8b590 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f82337fe700 1 --2- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f865b0 0x55e168f869b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f8238ced700 1 --2- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f8ba10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f822c00b000 tx=0x7f822c0091d0).ready entity=mon.1 client_cookie=d01318c1eb33d400 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f823a750700 1 -- 172.21.15.31:0/345005705 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f822c014440 con 0x55e168f8b590 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f823a750700 1 -- 172.21.15.31:0/345005705 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c0145a0 con 0x55e168f8b590 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.923+0000 7f823a750700 1 -- 172.21.15.31:0/345005705 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f822c014900 con 0x55e168f8b590 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 -- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 msgr2=0x55e168f8ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f8ba10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f822c00b000 tx=0x7f822c0091d0).stop 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 -- 172.21.15.31:0/345005705 shutdown_connections 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f79a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f8ba10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/345005705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f865b0 0x55e168f869b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 -- 172.21.15.31:0/345005705 >> 172.21.15.31:0/345005705 conn(0x55e168f25970 msgr2=0x55e168e7f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 -- 172.21.15.31:0/345005705 shutdown_connections 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 -- 172.21.15.31:0/345005705 wait complete. 2024-04-26T07:28:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.924+0000 7f824c1d7b80 1 -- start start 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f824c1d7b80 1 Processor -- start 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f7d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f7e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f91570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e168eb1180 con 0x55e168f861d0 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f8233fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f7d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f82337fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f7e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f8233fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f7d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42508/0 (socket says 172.21.15.31:42508) 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f8238ced700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f91570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f8233fff700 1 -- 172.21.15.31:0/755952163 learned_addr learned my addr 172.21.15.31:0/755952163 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e168e917f0 con 0x55e168f8b590 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e168e81710 con 0x55e168f865b0 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.925+0000 7f824c1d7b80 10 client.0 ll_register_callbacks cb 0x55e168ea6570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T07:28:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8238ced700 1 -- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 msgr2=0x55e168f7e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8238ced700 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f7e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8238ced700 1 -- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 msgr2=0x55e168f7d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8238ced700 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f7d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8238ced700 1 -- 172.21.15.31:0/755952163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8234094250 con 0x55e168f8b590 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f82337fe700 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f7e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8233fff700 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f7d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8238ced700 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f91570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f822c00b000 tx=0x7f822c01c000).ready entity=mon.1 client_cookie=7015bb7e053b67a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8212ffd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3301/0 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8212ffd700 1 -- 172.21.15.31:0/755952163 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f822c023070 con 0x55e168f8b590 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8212ffd700 1 -- 172.21.15.31:0/755952163 <== mon.1 v2:172.21.15.31:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f822c01c800 con 0x55e168f8b590 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e168e280c0 con 0x55e168f8b590 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8212ffd700 1 -- 172.21.15.31:0/755952163 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f822c014440 con 0x55e168f8b590 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f824c1d7b80 10 client.4507 fetch_fsmap learned FSMap version 9 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f822c0112c0 con 0x55e168f8b590 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8212ffd700 1 -- 172.21.15.31:0/755952163 <== mon.1 v2:172.21.15.31:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e168e280c0 con 0x55e168f8b590 2024-04-26T07:28:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f8212ffd700 1 -- 172.21.15.31:0/755952163 <== mon.1 v2:172.21.15.31:3301/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f822c026070 con 0x55e168f8b590 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f824c1d7b80 10 client.4507 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f824c1d7b80 10 client.4507 resolve_mds: resolved ID 'c' to GID 4207 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f824c1d7b80 20 client.4507 populate_metadata read hostname 'smithi031' 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f824c1d7b80 4 client.4507 mds_command: new command op to 4207 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.926+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 --> v1:172.21.15.31:6819/4068193720 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e168ea7230 con 0x55e168f94670 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f8212ffd700 10 client.4507 ms_handle_connect on v1:172.21.15.31:6819/4068193720 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f8212ffd700 1 -- 172.21.15.31:0/755952163 <== mds.0 v1:172.21.15.31:6819/4068193720 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55e168ea7230 con 0x55e168f94670 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f8212ffd700 10 client.4507 handle_command_reply: tid=0 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f824c1d7b80 1 client.4507 shutdown 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 msgr2=0x55e168f91570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f91570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f822c00b000 tx=0x7f822c01c000).stop 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 shutdown_connections 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f91570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f7d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/755952163 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f7e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f8212ffd700 0 client.4507 ms_handle_reset on v1:172.21.15.31:6819/4068193720 2024-04-26T07:28:44.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.927+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 >> 172.21.15.31:0/755952163 conn(0x55e168f25970 msgr2=0x55e168e7acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.928+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 shutdown_connections 2024-04-26T07:28:44.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.928+0000 7f824c1d7b80 1 -- 172.21.15.31:0/755952163 wait complete. 2024-04-26T07:28:44.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.928+0000 7f824c1d7b80 20 client.4507 trim_cache size 0 max 16384 2024-04-26T07:28:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.944+0000 7f824c1d7b80 1 Processor -- start 2024-04-26T07:28:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.944+0000 7f824c1d7b80 1 -- start start 2024-04-26T07:28:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.944+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f91570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.944+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f79f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.944+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f7e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e168f37cb0 con 0x55e168f861d0 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e168f59700 con 0x55e168f8b590 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e168fa2ad0 con 0x55e168f865b0 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f82337fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f79f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f82337fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f79f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:35156/0 (socket says 172.21.15.31:35156) 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f82337fe700 1 -- 172.21.15.31:0/282596093 learned_addr learned my addr 172.21.15.31:0/282596093 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f8238ced700 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f7e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f8233fff700 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f91570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f8233fff700 1 -- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 msgr2=0x55e168f79f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f8233fff700 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f79f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f8233fff700 1 -- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 msgr2=0x55e168f7e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f8233fff700 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f7e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f8233fff700 1 -- 172.21.15.31:0/282596093 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e168ea0ae0 con 0x55e168f861d0 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f82337fe700 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f79f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f8233fff700 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f91570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x55e168f57b40 tx=0x7f821c013000).ready entity=mon.0 client_cookie=55803863d3ecd735 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f82297fa700 1 -- 172.21.15.31:0/282596093 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821c00ddf0 con 0x55e168f861d0 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f82297fa700 1 -- 172.21.15.31:0/282596093 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c026040 con 0x55e168f861d0 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.945+0000 7f82297fa700 1 -- 172.21.15.31:0/282596093 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821c02a660 con 0x55e168f861d0 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 -- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 msgr2=0x55e168f91570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f91570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x55e168f57b40 tx=0x7f821c013000).stop 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 -- 172.21.15.31:0/282596093 shutdown_connections 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f8b590 0x55e168f7e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f861d0 0x55e168f91570 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/282596093 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f865b0 0x55e168f79f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 -- 172.21.15.31:0/282596093 >> 172.21.15.31:0/282596093 conn(0x55e168f25970 msgr2=0x55e168f7be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 -- 172.21.15.31:0/282596093 shutdown_connections 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 -- 172.21.15.31:0/282596093 wait complete. 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 -- start start 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.946+0000 7f824c1d7b80 1 Processor -- start 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f865b0 0x55e168f8d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f824c1d7b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f8b590 0x55e168f8de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e168f98520 con 0x55e168f8b590 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e168f97ac0 con 0x55e168f865b0 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f824c1d7b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e168f7ec60 con 0x55e168f861d0 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f824c1d7b80 10 client.0 ll_register_callbacks cb 0x55e168f7f1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f82337fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f865b0 0x55e168f8d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f8233fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f8238ced700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f8b590 0x55e168f8de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f82337fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f865b0 0x55e168f8d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44356/0 (socket says 172.21.15.31:44356) 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f8233fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:35160/0 (socket says 172.21.15.31:35160) 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f82337fe700 1 -- 172.21.15.31:0/2842942069 learned_addr learned my addr 172.21.15.31:0/2842942069 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f82337fe700 1 -- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 msgr2=0x55e168f987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f82337fe700 1 --2- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f82337fe700 1 -- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f8b590 msgr2=0x55e168f8de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f82337fe700 1 --2- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f8b590 0x55e168f8de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f82337fe700 1 -- 172.21.15.31:0/2842942069 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c00b1e0 con 0x55e168f865b0 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.947+0000 7f8238ced700 1 --2- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f8b590 0x55e168f8de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f82337fe700 1 --2- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f865b0 0x55e168f8d980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8224015f20 tx=0x7f8224015000).ready entity=mon.1 client_cookie=59d3b60bcd5c2635 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:44.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f8213fff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3301/0 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f8213fff700 1 -- 172.21.15.31:0/2842942069 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8224032b50 con 0x55e168f865b0 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f8213fff700 1 -- 172.21.15.31:0/2842942069 <== mon.1 v2:172.21.15.31:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8224032cb0 con 0x55e168f865b0 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f824c1d7b80 1 -- 172.21.15.31:0/2842942069 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f822c0145a0 con 0x55e168f865b0 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f8213fff700 1 -- 172.21.15.31:0/2842942069 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8224032e70 con 0x55e168f865b0 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f824c1d7b80 10 client.4513 fetch_fsmap learned FSMap version 9 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f824c1d7b80 1 -- 172.21.15.31:0/2842942069 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f82341363a0 con 0x55e168f865b0 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f8213fff700 1 -- 172.21.15.31:0/2842942069 <== mon.1 v2:172.21.15.31:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822403f030 con 0x55e168f865b0 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f8213fff700 1 -- 172.21.15.31:0/2842942069 <== mon.1 v2:172.21.15.31:3301/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f8224028070 con 0x55e168f865b0 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f824c1d7b80 10 client.4513 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f824c1d7b80 10 client.4513 resolve_mds: resolved ID 'c' to GID 4207 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f824c1d7b80 20 client.4513 populate_metadata read hostname 'smithi031' 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f824c1d7b80 4 client.4513 mds_command: new command op to 4207 tid=0[{"prefix": "status"}] 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f824c1d7b80 1 -- 172.21.15.31:0/2842942069 --> v1:172.21.15.31:6819/4068193720 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e168e9f570 con 0x55e168f8e360 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.948+0000 7f8213fff700 10 client.4513 ms_handle_connect on v1:172.21.15.31:6819/4068193720 2024-04-26T07:28:44.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f8213fff700 1 -- 172.21.15.31:0/2842942069 <== mds.0 v1:172.21.15.31:6819/4068193720 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+299 (unknown 0 0 3170573401) 0x55e168e9f570 con 0x55e168f8e360 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f8213fff700 10 client.4513 handle_command_reply: tid=0 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 client.4513 shutdown 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 -- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f865b0 msgr2=0x55e168f8d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f865b0 0x55e168f8d980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8224015f20 tx=0x7f8224015000).stop 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 -- 172.21.15.31:0/2842942069 shutdown_connections 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55e168f861d0 0x55e168f987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f8213fff700 0 client.4513 ms_handle_reset on v1:172.21.15.31:6819/4068193720 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e168f8b590 0x55e168f8de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 --2- 172.21.15.31:0/2842942069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55e168f865b0 0x55e168f8d980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 -- 172.21.15.31:0/2842942069 >> 172.21.15.31:0/2842942069 conn(0x55e168f25970 msgr2=0x55e168f58300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 -- 172.21.15.31:0/2842942069 shutdown_connections 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 1 -- 172.21.15.31:0/2842942069 wait complete. 2024-04-26T07:28:44.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.949+0000 7f824c1d7b80 20 client.4513 trim_cache size 0 max 16384 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "1efcad47-d196-4e33-a2f1-15c92eeb84f0", 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4207, 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 13.815550571999999, 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 9, 2024-04-26T07:28:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 18, 2024-04-26T07:28:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 18, 2024-04-26T07:28:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 22.815161817 2024-04-26T07:28:44.958 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-26T07:28:44.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 -- 172.21.15.31:0/3631452200 >> v1:172.21.15.31:6816/39613 conn(0x7f8218038e30 legacy=0x7f821803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 -- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409bc70 msgr2=0x7f82341490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:44.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409bc70 0x7f82341490e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f823413c700 tx=0x7f8224007a30).stop 2024-04-26T07:28:44.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 -- 172.21.15.31:0/3631452200 shutdown_connections 2024-04-26T07:28:44.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823409c070 0x7f82341495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8234067500 0x7f8234093920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 --2- 172.21.15.31:0/3631452200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823409bc70 0x7f82341490e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:44.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 -- 172.21.15.31:0/3631452200 >> 172.21.15.31:0/3631452200 conn(0x7f823405cfb0 msgr2=0x7f823413aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:44.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 -- 172.21.15.31:0/3631452200 shutdown_connections 2024-04-26T07:28:44.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:44.950+0000 7f823a750700 1 -- 172.21.15.31:0/3631452200 wait complete. 2024-04-26T07:28:44.962 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T07:28:44.972 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T07:28:44.972 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:28:44.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client octopus' 2024-04-26T07:28:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.077+0000 7f7054e0c700 1 Processor -- start 2024-04-26T07:28:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.077+0000 7f7054e0c700 1 -- start start 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f7054e0c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7050064380 0x7f7050062600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f7054e0c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f705013b680 0x7f705013da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f7054e0c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70501337b0 con 0x7f7050133300 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f7054e0c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7050062af0 con 0x7f705013b680 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f7054e0c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7050062da0 con 0x7f7050064380 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f704e59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7050064380 0x7f7050062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f704ed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f705013b680 0x7f705013da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f704dd9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7050133300 0x7f70500a9210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32910/0 (socket says 172.21.15.31:32910) 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f704dd9b700 1 -- 172.21.15.31:0/1142621928 learned_addr learned my addr 172.21.15.31:0/1142621928 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f704ed9d700 1 -- 172.21.15.31:0/1142621928 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7050064380 msgr2=0x7f7050062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f704d59a700 1 -- 172.21.15.31:0/1142621928 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764408891 0 0) 0x7f70501337b0 con 0x7f7050133300 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.078+0000 7f704ed9d700 1 --2- 172.21.15.31:0/1142621928 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7050064380 0x7f7050062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f704ed9d700 1 -- 172.21.15.31:0/1142621928 >> v1:172.21.15.31:6789/0 conn(0x7f7050133300 legacy=0x7f70500a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f704ed9d700 1 -- 172.21.15.31:0/1142621928 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7050063060 con 0x7f705013b680 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f704e59c700 1 --2- 172.21.15.31:0/1142621928 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7050064380 0x7f7050062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f704ed9d700 1 --2- 172.21.15.31:0/1142621928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f705013b680 0x7f705013da70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f70480032f0 tx=0x7f70480091d0).ready entity=mon.1 client_cookie=e3d74ba307f401f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f704d59a700 1 -- 172.21.15.31:0/1142621928 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704800b8b0 con 0x7f705013b680 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f704d59a700 1 -- 172.21.15.31:0/1142621928 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704800ba10 con 0x7f705013b680 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f704d59a700 1 -- 172.21.15.31:0/1142621928 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704800bd70 con 0x7f705013b680 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f7054e0c700 1 -- 172.21.15.31:0/1142621928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f705013b680 msgr2=0x7f705013da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f7054e0c700 1 --2- 172.21.15.31:0/1142621928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f705013b680 0x7f705013da70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f70480032f0 tx=0x7f70480091d0).stop 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f7054e0c700 1 -- 172.21.15.31:0/1142621928 shutdown_connections 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f7054e0c700 1 --2- 172.21.15.31:0/1142621928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f705013b680 0x7f705013da70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f7054e0c700 1 --2- 172.21.15.31:0/1142621928 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7050064380 0x7f7050062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f7054e0c700 1 -- 172.21.15.31:0/1142621928 >> 172.21.15.31:0/1142621928 conn(0x7f705006c200 msgr2=0x7f705006c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f7054e0c700 1 -- 172.21.15.31:0/1142621928 shutdown_connections 2024-04-26T07:28:45.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.079+0000 7f7054e0c700 1 -- 172.21.15.31:0/1142621928 wait complete. 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.080+0000 7f7054e0c700 1 Processor -- start 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.080+0000 7f7054e0c700 1 -- start start 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f7054e0c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7050064380 0x7f70500920e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f7054e0c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7050133300 0x7f705012f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f7054e0c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f705013b680 0x7f705012fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f7054e0c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7050094290 con 0x7f7050133300 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f7054e0c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70500927a0 con 0x7f7050064380 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f7054e0c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7050092ef0 con 0x7f705013b680 2024-04-26T07:28:45.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7050064380 0x7f70500920e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704ed9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f705013b680 0x7f705012fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7050133300 0x7f705012f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7050064380 0x7f70500920e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44372/0 (socket says 172.21.15.31:44372) 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 -- 172.21.15.31:0/3263999333 learned_addr learned my addr 172.21.15.31:0/3263999333 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 -- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f705013b680 msgr2=0x7f705012fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f705013b680 0x7f705012fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 -- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7050133300 msgr2=0x7f705012f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7050133300 0x7f705012f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 -- 172.21.15.31:0/3263999333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704400b180 con 0x7f7050064380 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704ed9d700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f705013b680 0x7f705012fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704dd9b700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7050133300 0x7f705012f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.081+0000 7f704e59c700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7050064380 0x7f70500920e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f704400c000 tx=0x7f7044006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.082+0000 7f703f7fe700 1 -- 172.21.15.31:0/3263999333 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704400c5f0 con 0x7f7050064380 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.082+0000 7f703f7fe700 1 -- 172.21.15.31:0/3263999333 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704400c750 con 0x7f7050064380 2024-04-26T07:28:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.082+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7048009470 con 0x7f7050064380 2024-04-26T07:28:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.082+0000 7f703f7fe700 1 -- 172.21.15.31:0/3263999333 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704400cab0 con 0x7f7050064380 2024-04-26T07:28:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.082+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7050138920 con 0x7f7050064380 2024-04-26T07:28:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.082+0000 7f703f7fe700 1 -- 172.21.15.31:0/3263999333 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f704400cc10 con 0x7f7050064380 2024-04-26T07:28:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.083+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7050057a60 con 0x7f7050064380 2024-04-26T07:28:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.083+0000 7f703f7fe700 1 -- 172.21.15.31:0/3263999333 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f704404ad90 con 0x7f7050064380 2024-04-26T07:28:45.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.086+0000 7f703f7fe700 1 -- 172.21.15.31:0/3263999333 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f70440336c0 con 0x7f7050064380 2024-04-26T07:28:45.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.212+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "octopus"} v 0) v1 -- 0x7f7050064d50 con 0x7f7050064380 2024-04-26T07:28:45.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.901+0000 7f703f7fe700 1 -- 172.21.15.31:0/3263999333 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "octopus"}]=0 set require_min_compat_client to octopus v19) v1 ==== 143+0+0 (secure 0 0 0) 0x7f70440332b0 con 0x7f7050064380 2024-04-26T07:28:45.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 >> v1:172.21.15.31:6816/39613 conn(0x7f702c038da0 legacy=0x7f702c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7050064380 msgr2=0x7f70500920e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7050064380 0x7f70500920e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f704400c000 tx=0x7f7044006df0).stop 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 shutdown_connections 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f705013b680 0x7f705012fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7050064380 0x7f70500920e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 --2- 172.21.15.31:0/3263999333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7050133300 0x7f705012f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 >> 172.21.15.31:0/3263999333 conn(0x7f705006c200 msgr2=0x7f70500a71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 shutdown_connections 2024-04-26T07:28:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:45.904+0000 7f7054e0c700 1 -- 172.21.15.31:0/3263999333 wait complete. 2024-04-26T07:28:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:set require_min_compat_client to octopus 2024-04-26T07:28:45.916 INFO:teuthology.run_tasks:Running task print... 2024-04-26T07:28:45.925 INFO:teuthology.task.print:**** done ceph 2024-04-26T07:28:45.925 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T07:28:45.971 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T07:28:45.971 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-26T07:28:45.972 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T07:28:45.972 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T07:28:45.972 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T07:28:45.972 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-26T07:28:45.972 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T07:28:45.972 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T07:28:45.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:45.972 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-04-26T07:28:45.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:45.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2024-04-26T07:28:46.074 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2024-04-26T07:28:46.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:28:46.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:46.075 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-26T07:28:46.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:46.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-26T07:28:46.173 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2024-04-26T07:28:46.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:28:46.175 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T07:28:46.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T07:28:46.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.294+0000 7ff84aeba700 1 Processor -- start 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.294+0000 7ff84aeba700 1 -- start start 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff84aeba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440679d0 0x7ff8441339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff84aeba700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff84413ea20 0x7ff844140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff84aeba700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff844133ea0 con 0x7ff8441335d0 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff84aeba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440670c0 con 0x7ff8440679d0 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff84aeba700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff844066600 con 0x7ff84413ea20 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff843fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440679d0 0x7ff8441339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff849457700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff84413ea20 0x7ff844140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff849457700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff84413ea20 0x7ff844140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:35194/0 (socket says 172.21.15.31:35194) 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff848c56700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff8441335d0 0x7ff8440a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:32920/0 (socket says 172.21.15.31:32920) 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff843fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440679d0 0x7ff8441339b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44382/0 (socket says 172.21.15.31:44382) 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff849457700 1 -- 172.21.15.31:0/4231623820 learned_addr learned my addr 172.21.15.31:0/4231623820 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff849457700 1 -- 172.21.15.31:0/4231623820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440679d0 msgr2=0x7ff8441339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff849457700 1 --2- 172.21.15.31:0/4231623820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440679d0 0x7ff8441339b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.295+0000 7ff849457700 1 -- 172.21.15.31:0/4231623820 >> v1:172.21.15.31:6789/0 conn(0x7ff8441335d0 legacy=0x7ff8440a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff849457700 1 -- 172.21.15.31:0/4231623820 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844066de0 con 0x7ff84413ea20 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff8437fe700 1 -- 172.21.15.31:0/4231623820 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293264276 0 0) 0x7ff844133ea0 con 0x7ff8441335d0 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff843fff700 1 --2- 172.21.15.31:0/4231623820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440679d0 0x7ff8441339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff849457700 1 --2- 172.21.15.31:0/4231623820 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff84413ea20 0x7ff844140e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff83c0032f0 tx=0x7ff83c009290).ready entity=mon.2 client_cookie=82eb30d831fcf845 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff8437fe700 1 -- 172.21.15.31:0/4231623820 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff83c00b8a0 con 0x7ff84413ea20 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff8437fe700 1 -- 172.21.15.31:0/4231623820 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00ba00 con 0x7ff84413ea20 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff8437fe700 1 -- 172.21.15.31:0/4231623820 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff83c00bb70 con 0x7ff84413ea20 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff84aeba700 1 -- 172.21.15.31:0/4231623820 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff84413ea20 msgr2=0x7ff844140e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff84aeba700 1 --2- 172.21.15.31:0/4231623820 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff84413ea20 0x7ff844140e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff83c0032f0 tx=0x7ff83c009290).stop 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff84aeba700 1 -- 172.21.15.31:0/4231623820 shutdown_connections 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff84aeba700 1 --2- 172.21.15.31:0/4231623820 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff84413ea20 0x7ff844140e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff84aeba700 1 --2- 172.21.15.31:0/4231623820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8440679d0 0x7ff8441339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff84aeba700 1 -- 172.21.15.31:0/4231623820 >> 172.21.15.31:0/4231623820 conn(0x7ff844060ee0 msgr2=0x7ff8440a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff84aeba700 1 -- 172.21.15.31:0/4231623820 shutdown_connections 2024-04-26T07:28:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.296+0000 7ff84aeba700 1 -- 172.21.15.31:0/4231623820 wait complete. 2024-04-26T07:28:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.297+0000 7ff84aeba700 1 Processor -- start 2024-04-26T07:28:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.297+0000 7ff84aeba700 1 -- start start 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff84aeba700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff8440679d0 0x7ff8440a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff84aeba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8441335d0 0x7ff844149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff84aeba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff84413ea20 0x7ff844149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff84aeba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440a1750 con 0x7ff8441335d0 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff84aeba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440a1a10 con 0x7ff84413ea20 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff84aeba700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440a8110 con 0x7ff8440679d0 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff849457700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff84413ea20 0x7ff844149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff843fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8441335d0 0x7ff844149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff849457700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff84413ea20 0x7ff844149540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44388/0 (socket says 172.21.15.31:44388) 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff849457700 1 -- 172.21.15.31:0/1256701984 learned_addr learned my addr 172.21.15.31:0/1256701984 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.298+0000 7ff848c56700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff8440679d0 0x7ff8440a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff843fff700 1 -- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff8440679d0 msgr2=0x7ff8440a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff843fff700 1 --2- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff8440679d0 0x7ff8440a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff843fff700 1 -- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff84413ea20 msgr2=0x7ff844149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff843fff700 1 --2- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff84413ea20 0x7ff844149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff843fff700 1 -- 172.21.15.31:0/1256701984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83000b180 con 0x7ff8441335d0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff849457700 1 --2- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff84413ea20 0x7ff844149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff843fff700 1 --2- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8441335d0 0x7ff844149050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff83000c000 tx=0x7ff830006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff841ffb700 1 -- 172.21.15.31:0/1256701984 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff830010780 con 0x7ff8441335d0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff841ffb700 1 -- 172.21.15.31:0/1256701984 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8300108e0 con 0x7ff8441335d0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c009530 con 0x7ff8441335d0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff841ffb700 1 -- 172.21.15.31:0/1256701984 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff830010c40 con 0x7ff8441335d0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.299+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff844136fb0 con 0x7ff8441335d0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.300+0000 7ff841ffb700 1 -- 172.21.15.31:0/1256701984 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff83001c460 con 0x7ff8441335d0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.300+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff844065ba0 con 0x7ff8441335d0 2024-04-26T07:28:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.300+0000 7ff841ffb700 1 -- 172.21.15.31:0/1256701984 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff83004ac50 con 0x7ff8441335d0 2024-04-26T07:28:46.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.303+0000 7ff841ffb700 1 -- 172.21.15.31:0/1256701984 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff830033580 con 0x7ff8441335d0 2024-04-26T07:28:46.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.453+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff84406bbc0 con 0x7ff8441335d0 2024-04-26T07:28:46.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.453+0000 7ff841ffb700 1 -- 172.21.15.31:0/1256701984 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff83001c6f0 con 0x7ff8441335d0 2024-04-26T07:28:46.453 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 >> v1:172.21.15.31:6816/39613 conn(0x7ff824038da0 legacy=0x7ff82403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8441335d0 msgr2=0x7ff844149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 --2- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8441335d0 0x7ff844149050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff83000c000 tx=0x7ff830006df0).stop 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 shutdown_connections 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 --2- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff8440679d0 0x7ff8440a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 --2- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff84413ea20 0x7ff844149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 --2- 172.21.15.31:0/1256701984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8441335d0 0x7ff844149050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 >> 172.21.15.31:0/1256701984 conn(0x7ff844060ee0 msgr2=0x7ff8440a8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 shutdown_connections 2024-04-26T07:28:46.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:46.454+0000 7ff84aeba700 1 -- 172.21.15.31:0/1256701984 wait complete. 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T07:28:46.465 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T07:28:46.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:46.466 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2024-04-26T07:28:46.489 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T07:28:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T07:28:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T07:28:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-04-26T07:28:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-04-26T07:28:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-04-26T07:28:46.489 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T07:28:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42587sec preferred_lft 42587sec 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2024-04-26T07:28:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2024-04-26T07:28:46.491 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T07:28:46.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:46.491 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-04-26T07:28:46.491 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-26T07:28:46.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2024-04-26T07:28:46.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2024-04-26T07:28:46.492 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2024-04-26T07:28:46.492 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T07:28:46.492 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-26T07:28:46.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:46.660 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T07:28:46.693 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-04-26T07:28:46.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:46.694 DEBUG:teuthology.orchestra.run.smithi057:> route 2024-04-26T07:28:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2024-04-26T07:28:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T07:28:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T07:28:46.779 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T07:28:46.780 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T07:28:46.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:46.780 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-04-26T07:28:46.780 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-26T07:28:46.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T07:28:46.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T07:28:46.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T07:28:46.780 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-26T07:28:47.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:47.019 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-04-26T07:28:47.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:47.037 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2024-04-26T07:28:47.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:47.095 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-04-26T07:28:47.095 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-26T07:28:47.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T07:28:47.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T07:28:47.095 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-26T07:28:47.191 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T07:28:47.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:47.191 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-04-26T07:28:47.191 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-26T07:28:47.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T07:28:47.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T07:28:47.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T07:28:47.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T07:28:47.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T07:28:47.191 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-26T07:28:47.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:47.424 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2024-04-26T07:28:47.424 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-26T07:28:47.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2024-04-26T07:28:47.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T07:28:47.424 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-26T07:28:47.522 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T07:28:47.522 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T07:28:47.522 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T07:28:47.540 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T07:28:47.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T07:28:47.540 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T07:28:47.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-04-26T07:28:47.666 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T07:28:47.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T07:28:47.733 INFO:teuthology.orchestra.run.smithi057.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T07:28:47.734 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T07:28:47.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:47.735 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-04-26T07:28:47.794 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T07:28:47.794 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T07:28:47.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-04-26T07:28:47.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T07:28:47.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T07:28:47.933 INFO:teuthology.orchestra.run.smithi057.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T07:28:47.934 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T07:28:47.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:47.935 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-04-26T07:28:47.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:2024-04-26T07:28:47.949+0000 7f214134f200 -1 init, newargv = 0x55661d826520 newargc=9 2024-04-26T07:28:47.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[37426]: starting ceph client 2024-04-26T07:28:47.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[37426]: starting fuse 2024-04-26T07:28:47.971 INFO:teuthology.orchestra.run.smithi057.stdout:47 2024-04-26T07:28:47.971 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-04-26T07:28:47.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-26T07:28:47.972 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2024-04-26T07:28:47.972 DEBUG:teuthology.orchestra.run.smithi057:> import re 2024-04-26T07:28:47.972 DEBUG:teuthology.orchestra.run.smithi057:> import os 2024-04-26T07:28:47.972 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2024-04-26T07:28:47.972 DEBUG:teuthology.orchestra.run.smithi057:> 2024-04-26T07:28:47.973 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2024-04-26T07:28:47.973 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T07:28:47.973 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2024-04-26T07:28:47.973 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T07:28:47.973 DEBUG:teuthology.orchestra.run.smithi057:> 2024-04-26T07:28:47.973 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2024-04-26T07:28:47.973 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2024-04-26T07:28:47.974 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2024-04-26T07:28:47.975 DEBUG:teuthology.orchestra.run.smithi057:> return f 2024-04-26T07:28:47.975 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T07:28:47.975 DEBUG:teuthology.orchestra.run.smithi057:> 2024-04-26T07:28:47.975 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.0")) 2024-04-26T07:28:47.975 DEBUG:teuthology.orchestra.run.smithi057:> ' 2024-04-26T07:28:48.096 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.0.37426.asok 2024-04-26T07:28:48.278 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37426.asok 2024-04-26T07:28:48.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:48.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37426.asok status 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "0", 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "37426", 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2024-04-26T07:28:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4532, 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 4532 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:0", 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 4293422267 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-26T07:28:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:0", 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 4293422267 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.4532 172.21.15.57:0/4293422267", 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "172.21.15.57:0/4293422267", 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 9, 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 19, 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklisted": false, 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2024-04-26T07:28:48.425 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-26T07:28:48.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T07:28:48.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.551+0000 7f28e5f78700 1 Processor -- start 2024-04-26T07:28:48.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.551+0000 7f28e5f78700 1 -- start start 2024-04-26T07:28:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28e5f78700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28e006c990 0x7f28e0136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28e5f78700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0136c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28e5f78700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e0133340 0x7f28e01337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28e5f78700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e0132eb0 con 0x7f28e006c990 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28e5f78700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e006cd70 con 0x7f28e00648b0 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28e5f78700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0063c00 con 0x7f28e0133340 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28deffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28df7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28e006c990 0x7f28e0136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28df7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28e006c990 0x7f28e0136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54086/0 (socket says 172.21.15.31:54086) 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28df7fe700 1 -- 172.21.15.31:0/886885802 learned_addr learned my addr 172.21.15.31:0/886885802 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28deffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0136c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46252/0 (socket says 172.21.15.31:46252) 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.552+0000 7f28dffff700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e0133340 0x7f28e01337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28df7fe700 1 -- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e0133340 msgr2=0x7f28e01337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28df7fe700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e0133340 0x7f28e01337d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28df7fe700 1 -- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 msgr2=0x7f28e0136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28df7fe700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0136c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28df7fe700 1 -- 172.21.15.31:0/886885802 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e01330a0 con 0x7f28e006c990 2024-04-26T07:28:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28deffd700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0136c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28df7fe700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e006c990 0x7f28e0136400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f28d0002f70 tx=0x7f28d0006eb0).ready entity=mon.0 client_cookie=e50f5d62133de16c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28de7fc700 1 -- 172.21.15.31:0/886885802 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d000d570 con 0x7f28e006c990 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28de7fc700 1 -- 172.21.15.31:0/886885802 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0000e90 con 0x7f28e006c990 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28de7fc700 1 -- 172.21.15.31:0/886885802 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d000d900 con 0x7f28e006c990 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28e5f78700 1 -- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e006c990 msgr2=0x7f28e0136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28e5f78700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e006c990 0x7f28e0136400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f28d0002f70 tx=0x7f28d0006eb0).stop 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28e5f78700 1 -- 172.21.15.31:0/886885802 shutdown_connections 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28e5f78700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e0133340 0x7f28e01337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28e5f78700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e006c990 0x7f28e0136400 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28e5f78700 1 --2- 172.21.15.31:0/886885802 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0136c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.553+0000 7f28e5f78700 1 -- 172.21.15.31:0/886885802 >> 172.21.15.31:0/886885802 conn(0x7f28e0061370 msgr2=0x7f28e006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.554+0000 7f28e5f78700 1 -- 172.21.15.31:0/886885802 shutdown_connections 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.554+0000 7f28e5f78700 1 -- 172.21.15.31:0/886885802 wait complete. 2024-04-26T07:28:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.555+0000 7f28e5f78700 1 Processor -- start 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.555+0000 7f28e5f78700 1 -- start start 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28e5f78700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0095ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28e5f78700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e006c990 0x7f28e0144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28e5f78700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e0133340 0x7f28e0145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28e5f78700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00937f0 con 0x7f28e0133340 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28e5f78700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0094080 con 0x7f28e00648b0 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28e5f78700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0094340 con 0x7f28e006c990 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28df7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0095ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e0133340 0x7f28e0145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28df7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0095ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46268/0 (socket says 172.21.15.31:46268) 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28df7fe700 1 -- 172.21.15.31:0/1319322094 learned_addr learned my addr 172.21.15.31:0/1319322094 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28deffd700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e006c990 0x7f28e0144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dffff700 1 -- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e006c990 msgr2=0x7f28e0144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dffff700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e006c990 0x7f28e0144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dffff700 1 -- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 msgr2=0x7f28e0095ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dffff700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0095ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dffff700 1 -- 172.21.15.31:0/1319322094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c800b180 con 0x7f28e0133340 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28df7fe700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0095ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dffff700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e0133340 0x7f28e0145130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f28d800c000 tx=0x7f28d80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dcff9700 1 -- 172.21.15.31:0/1319322094 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d8012600 con 0x7f28e0133340 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dcff9700 1 -- 172.21.15.31:0/1319322094 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d8012760 con 0x7f28e0133340 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d000b1e0 con 0x7f28e0133340 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28dcff9700 1 -- 172.21.15.31:0/1319322094 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d8012ac0 con 0x7f28e0133340 2024-04-26T07:28:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.556+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e0095000 con 0x7f28e0133340 2024-04-26T07:28:48.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.557+0000 7f28dcff9700 1 -- 172.21.15.31:0/1319322094 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f28d8022070 con 0x7f28e0133340 2024-04-26T07:28:48.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.557+0000 7f28dcff9700 1 -- 172.21.15.31:0/1319322094 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f28d804ad80 con 0x7f28e0133340 2024-04-26T07:28:48.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.557+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e00939f0 con 0x7f28e0133340 2024-04-26T07:28:48.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.561+0000 7f28dcff9700 1 -- 172.21.15.31:0/1319322094 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f28e00939f0 con 0x7f28e0133340 2024-04-26T07:28:48.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.712+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28e0133d40 con 0x7f28e0133340 2024-04-26T07:28:48.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.712+0000 7f28dcff9700 1 -- 172.21.15.31:0/1319322094 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28d8016070 con 0x7f28e0133340 2024-04-26T07:28:48.713 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T07:28:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 >> v1:172.21.15.31:6816/39613 conn(0x7f28c4038f50 legacy=0x7f28c403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e0133340 msgr2=0x7f28e0145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e0133340 0x7f28e0145130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f28d800c000 tx=0x7f28d80091d0).stop 2024-04-26T07:28:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 shutdown_connections 2024-04-26T07:28:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28e0133340 0x7f28e0145130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28e00648b0 0x7f28e0095ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 --2- 172.21.15.31:0/1319322094 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28e006c990 0x7f28e0144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:48.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 >> 172.21.15.31:0/1319322094 conn(0x7f28e0061370 msgr2=0x7f28e0062f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 shutdown_connections 2024-04-26T07:28:48.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:48.714+0000 7f28e5f78700 1 -- 172.21.15.31:0/1319322094 wait complete. 2024-04-26T07:28:48.724 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T07:28:48.725 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T07:28:48.725 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-26T07:28:48.725 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T07:28:48.725 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T07:28:48.725 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T07:28:48.725 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T07:28:48.725 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T07:28:48.725 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T07:28:48.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:48.725 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-26T07:28:48.748 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T07:28:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T07:28:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T07:28:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-26T07:28:48.748 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42569sec preferred_lft 42569sec 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2024-04-26T07:28:48.749 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-26T07:28:48.750 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T07:28:48.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:48.750 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-26T07:28:48.750 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-26T07:28:48.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2024-04-26T07:28:48.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2024-04-26T07:28:48.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2024-04-26T07:28:48.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T07:28:48.750 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-26T07:28:48.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:48.913 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T07:28:48.946 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-26T07:28:48.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:48.947 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-26T07:28:49.020 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-26T07:28:49.021 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T07:28:49.021 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T07:28:49.021 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T07:28:49.021 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T07:28:49.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:49.021 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-26T07:28:49.021 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-26T07:28:49.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T07:28:49.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T07:28:49.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T07:28:49.022 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-26T07:28:49.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:49.304 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-26T07:28:49.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:49.322 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2024-04-26T07:28:49.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:49.380 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-26T07:28:49.380 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-26T07:28:49.380 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T07:28:49.380 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T07:28:49.381 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-26T07:28:49.475 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T07:28:49.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:49.475 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-26T07:28:49.476 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-26T07:28:49.476 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T07:28:49.476 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T07:28:49.476 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T07:28:49.476 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T07:28:49.476 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T07:28:49.476 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-26T07:28:49.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:49.694 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-26T07:28:49.694 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-26T07:28:49.694 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-26T07:28:49.694 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T07:28:49.694 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-26T07:28:49.792 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T07:28:49.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T07:28:49.792 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T07:28:49.810 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T07:28:49.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T07:28:49.810 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T07:28:49.867 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-04-26T07:28:49.934 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T07:28:49.935 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T07:28:50.001 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T07:28:50.002 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T07:28:50.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:50.002 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-04-26T07:28:50.060 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T07:28:50.060 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T07:28:50.103 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-04-26T07:28:50.128 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T07:28:50.129 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T07:28:50.194 INFO:teuthology.orchestra.run.smithi172.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T07:28:50.195 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T07:28:50.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:50.195 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-04-26T07:28:50.223 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:2024-04-26T07:28:50.222+0000 7f040d7c8200 -1 init, newargv = 0x55975abaf100 newargc=9 2024-04-26T07:28:50.223 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[37422]: starting ceph client 2024-04-26T07:28:50.231 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[37422]: starting fuse 2024-04-26T07:28:50.240 INFO:teuthology.orchestra.run.smithi172.stdout:46 2024-04-26T07:28:50.240 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> import glob 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> import re 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> import subprocess 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> def _find_admin_socket(client_name): 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> files = glob.glob(asok_path) 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> # Given a non-glob path, it better be there 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> if "*" not in asok_path: 2024-04-26T07:28:50.241 DEBUG:teuthology.orchestra.run.smithi172:> assert(len(files) == 1) 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> return files[0] 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> for f in files: 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> contents = proc_f.read() 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> if mountpoint in contents: 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> return f 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> print(_find_admin_socket("client.1")) 2024-04-26T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-26T07:28:50.362 INFO:teuthology.orchestra.run.smithi172.stdout:/var/run/ceph/ceph-client.1.37422.asok 2024-04-26T07:28:50.545 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37422.asok 2024-04-26T07:28:50.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:50.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37422.asok status 2024-04-26T07:28:50.684 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-26T07:28:50.684 INFO:teuthology.orchestra.run.smithi172.stdout: "metadata": { 2024-04-26T07:28:50.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-04-26T07:28:50.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-04-26T07:28:50.685 INFO:teuthology.orchestra.run.smithi172.stdout: "entity_id": "1", 2024-04-26T07:28:50.685 INFO:teuthology.orchestra.run.smithi172.stdout: "hostname": "smithi172", 2024-04-26T07:28:50.685 INFO:teuthology.orchestra.run.smithi172.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T07:28:50.685 INFO:teuthology.orchestra.run.smithi172.stdout: "pid": "37422", 2024-04-26T07:28:50.685 INFO:teuthology.orchestra.run.smithi172.stdout: "root": "/" 2024-04-26T07:28:50.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_count": 0, 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_pinned_count": 0, 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 4728, 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: "inst": { 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: "name": { 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "client", 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: "num": 4728 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T07:28:50.686 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2024-04-26T07:28:50.687 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2024-04-26T07:28:50.687 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2024-04-26T07:28:50.687 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 1419329433 2024-04-26T07:28:50.687 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-26T07:28:50.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T07:28:50.687 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2024-04-26T07:28:50.687 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2024-04-26T07:28:50.687 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "172.21.15.172:0", 2024-04-26T07:28:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 1419329433 2024-04-26T07:28:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-26T07:28:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: "inst_str": "client.4728 172.21.15.172:0/1419329433", 2024-04-26T07:28:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: "addr_str": "172.21.15.172:0/1419329433", 2024-04-26T07:28:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: "inode_count": 1, 2024-04-26T07:28:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_epoch": 9, 2024-04-26T07:28:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch": 19, 2024-04-26T07:28:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch_barrier": 0, 2024-04-26T07:28:50.689 INFO:teuthology.orchestra.run.smithi172.stdout: "blacklisted": false, 2024-04-26T07:28:50.689 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs" 2024-04-26T07:28:50.689 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-26T07:28:50.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:50.694 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2024-04-26T07:28:50.694 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T07:28:50.717 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2024-04-26T07:28:50.717 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T07:28:50.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:50.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T07:28:50.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:50.794 DEBUG:teuthology.orchestra.run.smithi172:> stat --file-system '--printf=%T 2024-04-26T07:28:50.794 DEBUG:teuthology.orchestra.run.smithi172:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T07:28:50.813 INFO:teuthology.orchestra.run.smithi172.stdout:fuseblk 2024-04-26T07:28:50.813 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T07:28:50.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:28:50.814 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T07:28:52.145 INFO:teuthology.run_tasks:Running task print... 2024-04-26T07:28:52.156 INFO:teuthology.task.print:**** done octopus client 2024-04-26T07:28:52.157 INFO:teuthology.run_tasks:Running task print... 2024-04-26T07:28:52.196 INFO:teuthology.task.print:**** done fsstress 2024-04-26T07:28:52.196 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2024-04-26T07:28:52.242 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:52.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.364+0000 7f95475ba700 1 Processor -- start 2024-04-26T07:28:52.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.364+0000 7f95475ba700 1 -- start start 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f95475ba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95400a3170 0x7f954009e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f95475ba700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f95475ba700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954009e2a0 con 0x7f954009c9e0 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f95475ba700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954009ce70 con 0x7f95400a3170 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f95475ba700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f954009d110 con 0x7f954009f420 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f9545356700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95400a3170 0x7f954009e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f9545b57700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f9544b55700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f954009c9e0 0x7f95400a3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55998/0 (socket says 172.21.15.31:55998) 2024-04-26T07:28:52.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f9545356700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95400a3170 0x7f954009e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54110/0 (socket says 172.21.15.31:54110) 2024-04-26T07:28:52.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f9544b55700 1 -- 172.21.15.31:0/996088953 learned_addr learned my addr 172.21.15.31:0/996088953 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:52.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f9545356700 1 -- 172.21.15.31:0/996088953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 msgr2=0x7f95400a3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:52.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f9545356700 1 --2- 172.21.15.31:0/996088953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.365+0000 7f9545356700 1 -- 172.21.15.31:0/996088953 >> v1:172.21.15.31:6789/0 conn(0x7f954009c9e0 legacy=0x7f95400a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f9545356700 1 -- 172.21.15.31:0/996088953 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954005c4e0 con 0x7f95400a3170 2024-04-26T07:28:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f9545b57700 1 --2- 172.21.15.31:0/996088953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f9545356700 1 --2- 172.21.15.31:0/996088953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 0x7f954009e6f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f953c002f70 tx=0x7f953c006df0).ready entity=mon.0 client_cookie=fb630aaa591a28c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f952ffff700 1 -- 172.21.15.31:0/996088953 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953c00d570 con 0x7f95400a3170 2024-04-26T07:28:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f952ffff700 1 -- 172.21.15.31:0/996088953 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c000e90 con 0x7f95400a3170 2024-04-26T07:28:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f952ffff700 1 -- 172.21.15.31:0/996088953 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953c00d8c0 con 0x7f95400a3170 2024-04-26T07:28:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f95475ba700 1 -- 172.21.15.31:0/996088953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 msgr2=0x7f954009e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f95475ba700 1 --2- 172.21.15.31:0/996088953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 0x7f954009e6f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f953c002f70 tx=0x7f953c006df0).stop 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f95475ba700 1 -- 172.21.15.31:0/996088953 shutdown_connections 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f95475ba700 1 --2- 172.21.15.31:0/996088953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f95475ba700 1 --2- 172.21.15.31:0/996088953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 0x7f954009e6f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.366+0000 7f95475ba700 1 -- 172.21.15.31:0/996088953 >> 172.21.15.31:0/996088953 conn(0x7f9540060ee0 msgr2=0x7f95400a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.367+0000 7f95475ba700 1 -- 172.21.15.31:0/996088953 shutdown_connections 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.367+0000 7f95475ba700 1 -- 172.21.15.31:0/996088953 wait complete. 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.367+0000 7f95475ba700 1 Processor -- start 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.367+0000 7f95475ba700 1 -- start start 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f95475ba700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f95475ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 0x7f9540065ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f95475ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9540066090 0x7f9540066540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f95475ba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9540066a30 con 0x7f95400a3170 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f95475ba700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9540067310 con 0x7f9540066090 2024-04-26T07:28:52.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f95475ba700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95400a2b90 con 0x7f954009f420 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f9545356700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f9545b57700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9540066090 0x7f9540066540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f9544b55700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 0x7f9540065ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f9545356700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60376/0 (socket says 172.21.15.31:60376) 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.368+0000 7f9545356700 1 -- 172.21.15.31:0/2002310483 learned_addr learned my addr 172.21.15.31:0/2002310483 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f9545356700 1 -- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9540066090 msgr2=0x7f9540066540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f9545356700 1 --2- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9540066090 0x7f9540066540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f9545356700 1 -- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 msgr2=0x7f9540065ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f9545356700 1 --2- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 0x7f9540065ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f9545356700 1 -- 172.21.15.31:0/2002310483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538009470 con 0x7f954009f420 2024-04-26T07:28:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f9544b55700 1 --2- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 0x7f9540065ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f9545356700 1 --2- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a6af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9540066b70 tx=0x7f953c014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:52.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f952e7fc700 1 -- 172.21.15.31:0/2002310483 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953c013da0 con 0x7f954009f420 2024-04-26T07:28:52.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f952e7fc700 1 -- 172.21.15.31:0/2002310483 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c01e400 con 0x7f954009f420 2024-04-26T07:28:52.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953c00b180 con 0x7f954009f420 2024-04-26T07:28:52.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f952e7fc700 1 -- 172.21.15.31:0/2002310483 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953c01e760 con 0x7f954009f420 2024-04-26T07:28:52.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.369+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95400920a0 con 0x7f954009f420 2024-04-26T07:28:52.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.370+0000 7f952e7fc700 1 -- 172.21.15.31:0/2002310483 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f953c025030 con 0x7f954009f420 2024-04-26T07:28:52.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.370+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954006bbc0 con 0x7f954009f420 2024-04-26T07:28:52.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.370+0000 7f952e7fc700 1 -- 172.21.15.31:0/2002310483 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f953c04b5d0 con 0x7f954009f420 2024-04-26T07:28:52.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.373+0000 7f952e7fc700 1 -- 172.21.15.31:0/2002310483 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f953c0058c0 con 0x7f954009f420 2024-04-26T07:28:52.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.490+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95400a2cd0 con 0x7f954009f420 2024-04-26T07:28:52.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.491+0000 7f952e7fc700 1 -- 172.21.15.31:0/2002310483 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7f95400a2cd0 con 0x7f954009f420 2024-04-26T07:28:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:52.494 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:45.886508+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:52.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 >> v1:172.21.15.31:6816/39613 conn(0x7f9520038e30 legacy=0x7f952003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 msgr2=0x7f95400a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 --2- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a6af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9540066b70 tx=0x7f953c014000).stop 2024-04-26T07:28:52.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 shutdown_connections 2024-04-26T07:28:52.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 --2- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f954009f420 0x7f95400a6af0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 --2- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9540066090 0x7f9540066540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 --2- 172.21.15.31:0/2002310483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400a3170 0x7f9540065ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 >> 172.21.15.31:0/2002310483 conn(0x7f9540060ee0 msgr2=0x7f954005dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:52.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 shutdown_connections 2024-04-26T07:28:52.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.492+0000 7f95475ba700 1 -- 172.21.15.31:0/2002310483 wait complete. 2024-04-26T07:28:52.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T07:28:28.939656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T07:28:30.129744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T07:28:52.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:28:52.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.620+0000 7f09cbc4c700 1 Processor -- start 2024-04-26T07:28:52.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.620+0000 7f09cbc4c700 1 -- start start 2024-04-26T07:28:52.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09cbc4c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c41335d0 0x7f09c40679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09cbc4c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c40a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09cbc4c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c4067ec0 con 0x7f09c405b970 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09cbc4c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40670c0 con 0x7f09c41335d0 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09cbc4c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4066600 con 0x7f09c41339b0 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c99e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c41335d0 0x7f09c40679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c91e7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c40a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09ca1e9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f09c405b970 0x7f09c405be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56000/0 (socket says 172.21.15.31:56000) 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c91e7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c40a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60388/0 (socket says 172.21.15.31:60388) 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09ca1e9700 1 -- 172.21.15.31:0/3334110930 learned_addr learned my addr 172.21.15.31:0/3334110930 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c99e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c41335d0 0x7f09c40679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46286/0 (socket says 172.21.15.31:46286) 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c91e7700 1 -- 172.21.15.31:0/3334110930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c41335d0 msgr2=0x7f09c40679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c89e6700 1 -- 172.21.15.31:0/3334110930 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649309161 0 0) 0x7f09c4067ec0 con 0x7f09c405b970 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c91e7700 1 --2- 172.21.15.31:0/3334110930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c41335d0 0x7f09c40679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c91e7700 1 -- 172.21.15.31:0/3334110930 >> v1:172.21.15.31:6789/0 conn(0x7f09c405b970 legacy=0x7f09c405be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c91e7700 1 -- 172.21.15.31:0/3334110930 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4066de0 con 0x7f09c41339b0 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c99e8700 1 --2- 172.21.15.31:0/3334110930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c41335d0 0x7f09c40679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c91e7700 1 --2- 172.21.15.31:0/3334110930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c40a43e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f09b4002f70 tx=0x7f09b4006df0).ready entity=mon.2 client_cookie=492729ca2fb5c406 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c89e6700 1 -- 172.21.15.31:0/3334110930 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09b400d570 con 0x7f09c41339b0 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c89e6700 1 -- 172.21.15.31:0/3334110930 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b4000e90 con 0x7f09c41339b0 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.621+0000 7f09c89e6700 1 -- 172.21.15.31:0/3334110930 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09b400d8c0 con 0x7f09c41339b0 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.622+0000 7f09cbc4c700 1 -- 172.21.15.31:0/3334110930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 msgr2=0x7f09c40a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.622+0000 7f09cbc4c700 1 --2- 172.21.15.31:0/3334110930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c40a43e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f09b4002f70 tx=0x7f09b4006df0).stop 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.622+0000 7f09cbc4c700 1 -- 172.21.15.31:0/3334110930 shutdown_connections 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.622+0000 7f09cbc4c700 1 --2- 172.21.15.31:0/3334110930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c41335d0 0x7f09c40679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.622+0000 7f09cbc4c700 1 --2- 172.21.15.31:0/3334110930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c40a43e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.622+0000 7f09cbc4c700 1 -- 172.21.15.31:0/3334110930 >> 172.21.15.31:0/3334110930 conn(0x7f09c4060ee0 msgr2=0x7f09c40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.622+0000 7f09cbc4c700 1 -- 172.21.15.31:0/3334110930 shutdown_connections 2024-04-26T07:28:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.622+0000 7f09cbc4c700 1 -- 172.21.15.31:0/3334110930 wait complete. 2024-04-26T07:28:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.623+0000 7f09cbc4c700 1 Processor -- start 2024-04-26T07:28:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.623+0000 7f09cbc4c700 1 -- start start 2024-04-26T07:28:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.623+0000 7f09cbc4c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c405b970 0x7f09c40a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.623+0000 7f09cbc4c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09c41335d0 0x7f09c4149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.623+0000 7f09cbc4c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c4149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.623+0000 7f09cbc4c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4149d30 con 0x7f09c41335d0 2024-04-26T07:28:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.623+0000 7f09cbc4c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40a2080 con 0x7f09c405b970 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.623+0000 7f09cbc4c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40a1e20 con 0x7f09c41339b0 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c405b970 0x7f09c40a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c405b970 0x7f09c40a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46302/0 (socket says 172.21.15.31:46302) 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 -- 172.21.15.31:0/349077860 learned_addr learned my addr 172.21.15.31:0/349077860 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09ca1e9700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c4149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c91e7700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09c41335d0 0x7f09c4149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 -- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 msgr2=0x7f09c4149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c4149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 -- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09c41335d0 msgr2=0x7f09c4149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09c41335d0 0x7f09c4149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 -- 172.21.15.31:0/349077860 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c000b180 con 0x7f09c405b970 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09c99e8700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c405b970 0x7f09c40a1930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f09c000c000 tx=0x7f09c0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09b2ffd700 1 -- 172.21.15.31:0/349077860 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09c000c7e0 con 0x7f09c405b970 2024-04-26T07:28:52.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09b2ffd700 1 -- 172.21.15.31:0/349077860 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000c940 con 0x7f09c405b970 2024-04-26T07:28:52.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b400b180 con 0x7f09c405b970 2024-04-26T07:28:52.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09b2ffd700 1 -- 172.21.15.31:0/349077860 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09c000cca0 con 0x7f09c405b970 2024-04-26T07:28:52.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.624+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c4136fc0 con 0x7f09c405b970 2024-04-26T07:28:52.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.625+0000 7f09b2ffd700 1 -- 172.21.15.31:0/349077860 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f09c001c460 con 0x7f09c405b970 2024-04-26T07:28:52.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.625+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c4065ba0 con 0x7f09c405b970 2024-04-26T07:28:52.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.625+0000 7f09b2ffd700 1 -- 172.21.15.31:0/349077860 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f09c004ad90 con 0x7f09c405b970 2024-04-26T07:28:52.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.629+0000 7f09b2ffd700 1 -- 172.21.15.31:0/349077860 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f09c00336c0 con 0x7f09c405b970 2024-04-26T07:28:52.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.746+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f09c406bbc0 con 0x7f09c405b970 2024-04-26T07:28:52.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.746+0000 7f09b2ffd700 1 -- 172.21.15.31:0/349077860 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f09c000ce00 con 0x7f09c405b970 2024-04-26T07:28:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:28:52.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 >> v1:172.21.15.31:6816/39613 conn(0x7f09a4038dd0 legacy=0x7f09a403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c405b970 msgr2=0x7f09c40a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c405b970 0x7f09c40a1930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f09c000c000 tx=0x7f09c0006df0).stop 2024-04-26T07:28:52.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 shutdown_connections 2024-04-26T07:28:52.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f09c41339b0 0x7f09c4149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f09c405b970 0x7f09c40a1930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 --2- 172.21.15.31:0/349077860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09c41335d0 0x7f09c4149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 >> 172.21.15.31:0/349077860 conn(0x7f09c4060ee0 msgr2=0x7f09c40a2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:52.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 shutdown_connections 2024-04-26T07:28:52.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.748+0000 7f09cbc4c700 1 -- 172.21.15.31:0/349077860 wait complete. 2024-04-26T07:28:52.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:28:52.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.886+0000 7f10dd141700 1 Processor -- start 2024-04-26T07:28:52.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.886+0000 7f10dd141700 1 -- start start 2024-04-26T07:28:52.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.886+0000 7f10dd141700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d8065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.886+0000 7f10dd141700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d813ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.886+0000 7f10dd141700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d8065770 con 0x7f10d8134840 2024-04-26T07:28:52.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.886+0000 7f10dd141700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d809c5e0 con 0x7f10d813c830 2024-04-26T07:28:52.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.886+0000 7f10dd141700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8134240 con 0x7f10d8134460 2024-04-26T07:28:52.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d759e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d813ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d6d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d8065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f10d8134840 0x7f10d80635b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56010/0 (socket says 172.21.15.31:56010) 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d659c700 1 -- 172.21.15.31:0/349902853 learned_addr learned my addr 172.21.15.31:0/349902853 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d759e700 1 -- 172.21.15.31:0/349902853 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 msgr2=0x7f10d8065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d759e700 1 --2- 172.21.15.31:0/349902853 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d8065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d759e700 1 -- 172.21.15.31:0/349902853 >> v1:172.21.15.31:6789/0 conn(0x7f10d8134840 legacy=0x7f10d80635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d5d9b700 1 -- 172.21.15.31:0/349902853 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214738815 0 0) 0x7f10cc001110 con 0x7f10d8134840 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d759e700 1 -- 172.21.15.31:0/349902853 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8063cc0 con 0x7f10d813c830 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d6d9d700 1 --2- 172.21.15.31:0/349902853 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d8065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d759e700 1 --2- 172.21.15.31:0/349902853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d813ec20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f10d00032f0 tx=0x7f10d00091d0).ready entity=mon.1 client_cookie=a7cfd8975dec99f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d5d9b700 1 -- 172.21.15.31:0/349902853 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d000b6c0 con 0x7f10d813c830 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d5d9b700 1 -- 172.21.15.31:0/349902853 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000b820 con 0x7f10d813c830 2024-04-26T07:28:52.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.887+0000 7f10d5d9b700 1 -- 172.21.15.31:0/349902853 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d000b990 con 0x7f10d813c830 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.888+0000 7f10dd141700 1 -- 172.21.15.31:0/349902853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 msgr2=0x7f10d813ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.888+0000 7f10dd141700 1 --2- 172.21.15.31:0/349902853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d813ec20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f10d00032f0 tx=0x7f10d00091d0).stop 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.888+0000 7f10dd141700 1 -- 172.21.15.31:0/349902853 shutdown_connections 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.888+0000 7f10dd141700 1 --2- 172.21.15.31:0/349902853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d813ec20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.888+0000 7f10dd141700 1 --2- 172.21.15.31:0/349902853 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d8065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.888+0000 7f10dd141700 1 -- 172.21.15.31:0/349902853 >> 172.21.15.31:0/349902853 conn(0x7f10d805cfb0 msgr2=0x7f10d8062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.888+0000 7f10dd141700 1 -- 172.21.15.31:0/349902853 shutdown_connections 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.888+0000 7f10dd141700 1 -- 172.21.15.31:0/349902853 wait complete. 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10dd141700 1 Processor -- start 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10dd141700 1 -- start start 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10dd141700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d80671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10dd141700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d8134840 0x7f10d8135600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10dd141700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d8146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10dd141700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d81398b0 con 0x7f10d8134840 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10dd141700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8139ae0 con 0x7f10d813c830 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10dd141700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8139d80 con 0x7f10d8134460 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10d6d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d80671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10d6d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d80671d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60414/0 (socket says 172.21.15.31:60414) 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10d6d9d700 1 -- 172.21.15.31:0/3149962753 learned_addr learned my addr 172.21.15.31:0/3149962753 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10d659c700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d8134840 0x7f10d8135600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.889+0000 7f10d759e700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d8146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10d6d9d700 1 -- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 msgr2=0x7f10d8146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10d6d9d700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d8146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10d6d9d700 1 -- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d8134840 msgr2=0x7f10d8135600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10d6d9d700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d8134840 0x7f10d8135600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:52.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10d6d9d700 1 -- 172.21.15.31:0/3149962753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c800b180 con 0x7f10d8134460 2024-04-26T07:28:52.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10d6d9d700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d80671d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f10d80679c0 tx=0x7f10c8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:52.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10c7fff700 1 -- 172.21.15.31:0/3149962753 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c800c5f0 con 0x7f10d8134460 2024-04-26T07:28:52.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10c7fff700 1 -- 172.21.15.31:0/3149962753 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c800c750 con 0x7f10d8134460 2024-04-26T07:28:52.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d0009470 con 0x7f10d8134460 2024-04-26T07:28:52.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10c7fff700 1 -- 172.21.15.31:0/3149962753 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c800cab0 con 0x7f10d8134460 2024-04-26T07:28:52.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.890+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d80676c0 con 0x7f10d8134460 2024-04-26T07:28:52.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.891+0000 7f10c7fff700 1 -- 172.21.15.31:0/3149962753 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f10c800cc10 con 0x7f10d8134460 2024-04-26T07:28:52.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.891+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d8133f10 con 0x7f10d8134460 2024-04-26T07:28:52.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.891+0000 7f10c7fff700 1 -- 172.21.15.31:0/3149962753 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f10c804ae30 con 0x7f10d8134460 2024-04-26T07:28:52.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:52.894+0000 7f10c7fff700 1 -- 172.21.15.31:0/3149962753 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f10c80336c0 con 0x7f10d8134460 2024-04-26T07:28:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.013+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10d8062b20 con 0x7f10d8134460 2024-04-26T07:28:53.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.013+0000 7f10c7fff700 1 -- 172.21.15.31:0/3149962753 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f10c80332b0 con 0x7f10d8134460 2024-04-26T07:28:53.014 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 >> v1:172.21.15.31:6816/39613 conn(0x7f10b4038e30 legacy=0x7f10b403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 msgr2=0x7f10d80671d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d80671d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f10d80679c0 tx=0x7f10c8006df0).stop 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 shutdown_connections 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f10d8134460 0x7f10d80671d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10d813c830 0x7f10d8146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 --2- 172.21.15.31:0/3149962753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10d8134840 0x7f10d8135600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 >> 172.21.15.31:0/3149962753 conn(0x7f10d805cfb0 msgr2=0x7f10d806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 shutdown_connections 2024-04-26T07:28:53.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.015+0000 7f10dd141700 1 -- 172.21.15.31:0/3149962753 wait complete. 2024-04-26T07:28:53.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T07:28:53.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.167+0000 7fcfd4ec0700 1 Processor -- start 2024-04-26T07:28:53.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.167+0000 7fcfd4ec0700 1 -- start start 2024-04-26T07:28:53.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.167+0000 7fcfd4ec0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfd0067500 0x7fcfd009a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.167+0000 7fcfd4ec0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0136d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.167+0000 7fcfd4ec0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd009b670 con 0x7fcfd009bc70 2024-04-26T07:28:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.167+0000 7fcfd4ec0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd01361b0 con 0x7fcfd0067500 2024-04-26T07:28:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.167+0000 7fcfd4ec0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd009b400 con 0x7fcfd009c0a0 2024-04-26T07:28:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.167+0000 7fcfce59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfd0067500 0x7fcfd009a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfced9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfcdd9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcfd009bc70 0x7fcfd0136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56018/0 (socket says 172.21.15.31:56018) 2024-04-26T07:28:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfcdd9b700 1 -- 172.21.15.31:0/1226043892 learned_addr learned my addr 172.21.15.31:0/1226043892 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfce59c700 1 -- 172.21.15.31:0/1226043892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 msgr2=0x7fcfd0136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfce59c700 1 --2- 172.21.15.31:0/1226043892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfce59c700 1 -- 172.21.15.31:0/1226043892 >> v1:172.21.15.31:6789/0 conn(0x7fcfd009bc70 legacy=0x7fcfd0136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfce59c700 1 -- 172.21.15.31:0/1226043892 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd01363a0 con 0x7fcfd0067500 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfcd59a700 1 -- 172.21.15.31:0/1226043892 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088595800 0 0) 0x7fcfd009b670 con 0x7fcfd009bc70 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfced9d700 1 --2- 172.21.15.31:0/1226043892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfce59c700 1 --2- 172.21.15.31:0/1226043892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd0067500 0x7fcfd009a8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fcfc0002f70 tx=0x7fcfc0006df0).ready entity=mon.0 client_cookie=581238bc484e3ced server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfcd59a700 1 -- 172.21.15.31:0/1226043892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfc000d570 con 0x7fcfd0067500 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfcd59a700 1 -- 172.21.15.31:0/1226043892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc0000e90 con 0x7fcfd0067500 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.168+0000 7fcfcd59a700 1 -- 172.21.15.31:0/1226043892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfc000d8c0 con 0x7fcfd0067500 2024-04-26T07:28:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.169+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1226043892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd0067500 msgr2=0x7fcfd009a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.169+0000 7fcfd4ec0700 1 --2- 172.21.15.31:0/1226043892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd0067500 0x7fcfd009a8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fcfc0002f70 tx=0x7fcfc0006df0).stop 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.169+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1226043892 shutdown_connections 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.169+0000 7fcfd4ec0700 1 --2- 172.21.15.31:0/1226043892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.169+0000 7fcfd4ec0700 1 --2- 172.21.15.31:0/1226043892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd0067500 0x7fcfd009a8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.169+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1226043892 >> 172.21.15.31:0/1226043892 conn(0x7fcfd005cfb0 msgr2=0x7fcfd0062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.169+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1226043892 shutdown_connections 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.169+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1226043892 wait complete. 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfd4ec0700 1 Processor -- start 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfd4ec0700 1 -- start start 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfd4ec0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfd0067500 0x7fcfd0093e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfd4ec0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd009bc70 0x7fcfd0095080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfd4ec0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfd4ec0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0094650 con 0x7fcfd009bc70 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfd4ec0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0092c80 con 0x7fcfd009c0a0 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfd4ec0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0094b80 con 0x7fcfd0067500 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfcdd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd009bc70 0x7fcfd0095080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfce59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfd0067500 0x7fcfd0093e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfcdd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd009bc70 0x7fcfd0095080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54160/0 (socket says 172.21.15.31:54160) 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfce59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfd0067500 0x7fcfd0093e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60416/0 (socket says 172.21.15.31:60416) 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfcdd9b700 1 -- 172.21.15.31:0/1482248793 learned_addr learned my addr 172.21.15.31:0/1482248793 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.170+0000 7fcfced9d700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfcdd9b700 1 -- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfd0067500 msgr2=0x7fcfd0093e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfcdd9b700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfd0067500 0x7fcfd0093e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfcdd9b700 1 -- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 msgr2=0x7fcfd0145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfcdd9b700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfcdd9b700 1 -- 172.21.15.31:0/1482248793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8009470 con 0x7fcfd009bc70 2024-04-26T07:28:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfce59c700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfd0067500 0x7fcfd0093e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfcdd9b700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd009bc70 0x7fcfd0095080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fcfd00947c0 tx=0x7fcfb8007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfc77fe700 1 -- 172.21.15.31:0/1482248793 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb80070d0 con 0x7fcfd009bc70 2024-04-26T07:28:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfc77fe700 1 -- 172.21.15.31:0/1482248793 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8007230 con 0x7fcfd009bc70 2024-04-26T07:28:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc000b180 con 0x7fcfd009bc70 2024-04-26T07:28:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfc77fe700 1 -- 172.21.15.31:0/1482248793 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb8005610 con 0x7fcfd009bc70 2024-04-26T07:28:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.171+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd0145a20 con 0x7fcfd009bc70 2024-04-26T07:28:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.172+0000 7fcfc77fe700 1 -- 172.21.15.31:0/1482248793 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fcfb801a060 con 0x7fcfd009bc70 2024-04-26T07:28:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.172+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd0067960 con 0x7fcfd009bc70 2024-04-26T07:28:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.172+0000 7fcfc77fe700 1 -- 172.21.15.31:0/1482248793 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcfb8049ca0 con 0x7fcfd009bc70 2024-04-26T07:28:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.175+0000 7fcfc77fe700 1 -- 172.21.15.31:0/1482248793 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcfb802eba0 con 0x7fcfd009bc70 2024-04-26T07:28:53.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.290+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfd0062b20 con 0x7fcfd009bc70 2024-04-26T07:28:53.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.291+0000 7fcfc77fe700 1 -- 172.21.15.31:0/1482248793 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfb8018020 con 0x7fcfd009bc70 2024-04-26T07:28:53.291 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-26T07:28:53.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 >> v1:172.21.15.31:6816/39613 conn(0x7fcfb4038da0 legacy=0x7fcfb403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd009bc70 msgr2=0x7fcfd0095080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd009bc70 0x7fcfd0095080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fcfd00947c0 tx=0x7fcfb8007a60).stop 2024-04-26T07:28:53.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 shutdown_connections 2024-04-26T07:28:53.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfd0067500 0x7fcfd0093e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfd009c0a0 0x7fcfd0145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 --2- 172.21.15.31:0/1482248793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfd009bc70 0x7fcfd0095080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 >> 172.21.15.31:0/1482248793 conn(0x7fcfd005cfb0 msgr2=0x7fcfd0132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:53.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 shutdown_connections 2024-04-26T07:28:53.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.292+0000 7fcfd4ec0700 1 -- 172.21.15.31:0/1482248793 wait complete. 2024-04-26T07:28:53.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T07:28:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.415+0000 7fe5c038f700 1 Processor -- start 2024-04-26T07:28:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.415+0000 7fe5c038f700 1 -- start start 2024-04-26T07:28:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.415+0000 7fe5c038f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5b806c990 0x7fe5b8136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.415+0000 7fe5c038f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8136c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5c038f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b806cd70 con 0x7fe5b8133340 2024-04-26T07:28:53.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5c038f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b8132eb0 con 0x7fe5b806c990 2024-04-26T07:28:53.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5c038f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8063c00 con 0x7fe5b80648b0 2024-04-26T07:28:53.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd92a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5be12b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5b806c990 0x7fe5b8136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd92a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8136c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46350/0 (socket says 172.21.15.31:46350) 2024-04-26T07:28:53.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5be92c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe5b8133340 0x7fe5b81337a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56030/0 (socket says 172.21.15.31:56030) 2024-04-26T07:28:53.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5be12b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5b806c990 0x7fe5b8136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54166/0 (socket says 172.21.15.31:54166) 2024-04-26T07:28:53.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd92a700 1 -- 172.21.15.31:0/11451109 learned_addr learned my addr 172.21.15.31:0/11451109 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd92a700 1 -- 172.21.15.31:0/11451109 >> v2:172.21.15.31:3300/0 conn(0x7fe5b806c990 msgr2=0x7fe5b8136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd92a700 1 --2- 172.21.15.31:0/11451109 >> v2:172.21.15.31:3300/0 conn(0x7fe5b806c990 0x7fe5b8136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd92a700 1 -- 172.21.15.31:0/11451109 >> v1:172.21.15.31:6789/0 conn(0x7fe5b8133340 legacy=0x7fe5b81337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd129700 1 -- 172.21.15.31:0/11451109 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991570113 0 0) 0x7fe5b806cd70 con 0x7fe5b8133340 2024-04-26T07:28:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd92a700 1 -- 172.21.15.31:0/11451109 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b81330a0 con 0x7fe5b80648b0 2024-04-26T07:28:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5be12b700 1 --2- 172.21.15.31:0/11451109 >> v2:172.21.15.31:3300/0 conn(0x7fe5b806c990 0x7fe5b8136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd92a700 1 --2- 172.21.15.31:0/11451109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8136c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe5b80a9bc0 tx=0x7fe5a8006eb0).ready entity=mon.1 client_cookie=732dc422369a17dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd129700 1 -- 172.21.15.31:0/11451109 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5a800d5c0 con 0x7fe5b80648b0 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd129700 1 -- 172.21.15.31:0/11451109 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8000e90 con 0x7fe5b80648b0 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.416+0000 7fe5bd129700 1 -- 172.21.15.31:0/11451109 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5a800d910 con 0x7fe5b80648b0 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.417+0000 7fe5c038f700 1 -- 172.21.15.31:0/11451109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 msgr2=0x7fe5b8136c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.417+0000 7fe5c038f700 1 --2- 172.21.15.31:0/11451109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8136c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe5b80a9bc0 tx=0x7fe5a8006eb0).stop 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.417+0000 7fe5c038f700 1 -- 172.21.15.31:0/11451109 shutdown_connections 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.417+0000 7fe5c038f700 1 --2- 172.21.15.31:0/11451109 >> v2:172.21.15.31:3300/0 conn(0x7fe5b806c990 0x7fe5b8136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.417+0000 7fe5c038f700 1 --2- 172.21.15.31:0/11451109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8136c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.417+0000 7fe5c038f700 1 -- 172.21.15.31:0/11451109 >> 172.21.15.31:0/11451109 conn(0x7fe5b8061370 msgr2=0x7fe5b806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.417+0000 7fe5c038f700 1 -- 172.21.15.31:0/11451109 shutdown_connections 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.417+0000 7fe5c038f700 1 -- 172.21.15.31:0/11451109 wait complete. 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.418+0000 7fe5c038f700 1 Processor -- start 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.418+0000 7fe5c038f700 1 -- start start 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.418+0000 7fe5c038f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8094990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.418+0000 7fe5c038f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5b806c990 0x7fe5b8144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.418+0000 7fe5c038f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5b8133340 0x7fe5b8144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.418+0000 7fe5c038f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8095e00 con 0x7fe5b8133340 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.418+0000 7fe5c038f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80960c0 con 0x7fe5b80648b0 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.418+0000 7fe5c038f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8094e80 con 0x7fe5b806c990 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8094990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8094990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46360/0 (socket says 172.21.15.31:46360) 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 -- 172.21.15.31:0/798441974 learned_addr learned my addr 172.21.15.31:0/798441974 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5bd92a700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5b806c990 0x7fe5b8144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be92c700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5b8133340 0x7fe5b8144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 -- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5b806c990 msgr2=0x7fe5b8144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5b806c990 0x7fe5b8144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 -- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5b8133340 msgr2=0x7fe5b8144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5b8133340 0x7fe5b8144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 -- 172.21.15.31:0/798441974 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b400b180 con 0x7fe5b80648b0 2024-04-26T07:28:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5be12b700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8094990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe5b400c000 tx=0x7fe5b4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:53.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5a77fe700 1 -- 172.21.15.31:0/798441974 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b400c5f0 con 0x7fe5b80648b0 2024-04-26T07:28:53.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5a77fe700 1 -- 172.21.15.31:0/798441974 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400c750 con 0x7fe5b80648b0 2024-04-26T07:28:53.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a800b1e0 con 0x7fe5b80648b0 2024-04-26T07:28:53.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5a77fe700 1 -- 172.21.15.31:0/798441974 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b400cab0 con 0x7fe5b80648b0 2024-04-26T07:28:53.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.419+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b8094080 con 0x7fe5b80648b0 2024-04-26T07:28:53.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.420+0000 7fe5a77fe700 1 -- 172.21.15.31:0/798441974 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe5b400cc10 con 0x7fe5b80648b0 2024-04-26T07:28:53.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.420+0000 7fe5a77fe700 1 -- 172.21.15.31:0/798441974 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe5b404ad90 con 0x7fe5b80648b0 2024-04-26T07:28:53.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.420+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b806bbc0 con 0x7fe5b80648b0 2024-04-26T07:28:53.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.424+0000 7fe5a77fe700 1 -- 172.21.15.31:0/798441974 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe5b40336c0 con 0x7fe5b80648b0 2024-04-26T07:28:53.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.539+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5b8064dd0 con 0x7fe5b80648b0 2024-04-26T07:28:53.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.540+0000 7fe5a77fe700 1 -- 172.21.15.31:0/798441974 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5b40332b0 con 0x7fe5b80648b0 2024-04-26T07:28:53.541 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-26T07:28:53.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 >> v1:172.21.15.31:6816/39613 conn(0x7fe598038f50 legacy=0x7fe59803b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 msgr2=0x7fe5b8094990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8094990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe5b400c000 tx=0x7fe5b4006df0).stop 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 shutdown_connections 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5b8133340 0x7fe5b8144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5b80648b0 0x7fe5b8094990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 --2- 172.21.15.31:0/798441974 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5b806c990 0x7fe5b8144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 >> 172.21.15.31:0/798441974 conn(0x7fe5b8061370 msgr2=0x7fe5b8062800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 shutdown_connections 2024-04-26T07:28:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.541+0000 7fe5c038f700 1 -- 172.21.15.31:0/798441974 wait complete. 2024-04-26T07:28:53.552 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:53.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.658+0000 7ff3bf632700 1 Processor -- start 2024-04-26T07:28:53.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.658+0000 7ff3bf632700 1 -- start start 2024-04-26T07:28:53.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bf632700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81335d0 0x7ff3b80679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bf632700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bf632700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b8067ec0 con 0x7ff3b81339b0 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bf632700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80670c0 con 0x7ff3b81335d0 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bf632700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8066600 con 0x7ff3b813ea20 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bd3ce700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81335d0 0x7ff3b80679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bcbcd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff3b81339b0 0x7ff3b80a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56044/0 (socket says 172.21.15.31:56044) 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bcbcd700 1 -- 172.21.15.31:0/1895811000 learned_addr learned my addr 172.21.15.31:0/1895811000 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bdbcf700 1 --2- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bd3ce700 1 -- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 msgr2=0x7ff3b8140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bd3ce700 1 --2- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3bd3ce700 1 -- 172.21.15.31:0/1895811000 >> v1:172.21.15.31:6789/0 conn(0x7ff3b81339b0 legacy=0x7ff3b80a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.659+0000 7ff3abfff700 1 -- 172.21.15.31:0/1895811000 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797611424 0 0) 0x7ff3b8067ec0 con 0x7ff3b81339b0 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bd3ce700 1 -- 172.21.15.31:0/1895811000 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8066de0 con 0x7ff3b81335d0 2024-04-26T07:28:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bdbcf700 1 --2- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bd3ce700 1 --2- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81335d0 0x7ff3b80679d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff3ac002f70 tx=0x7ff3ac006df0).ready entity=mon.1 client_cookie=621b4c3c53e86a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3abfff700 1 -- 172.21.15.31:0/1895811000 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ac00d570 con 0x7ff3b81335d0 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3abfff700 1 -- 172.21.15.31:0/1895811000 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac000e90 con 0x7ff3b81335d0 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3abfff700 1 -- 172.21.15.31:0/1895811000 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ac00d8c0 con 0x7ff3b81335d0 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bf632700 1 -- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81335d0 msgr2=0x7ff3b80679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bf632700 1 --2- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81335d0 0x7ff3b80679d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff3ac002f70 tx=0x7ff3ac006df0).stop 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bf632700 1 -- 172.21.15.31:0/1895811000 shutdown_connections 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bf632700 1 --2- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bf632700 1 --2- 172.21.15.31:0/1895811000 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81335d0 0x7ff3b80679d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bf632700 1 -- 172.21.15.31:0/1895811000 >> 172.21.15.31:0/1895811000 conn(0x7ff3b8060ee0 msgr2=0x7ff3b80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bf632700 1 -- 172.21.15.31:0/1895811000 shutdown_connections 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.660+0000 7ff3bf632700 1 -- 172.21.15.31:0/1895811000 wait complete. 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.661+0000 7ff3bf632700 1 Processor -- start 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.661+0000 7ff3bf632700 1 -- start start 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bf632700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3b81335d0 0x7ff3b8136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bf632700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81339b0 0x7ff3b80a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bf632700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bf632700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b809cad0 con 0x7ff3b81335d0 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bf632700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8135890 con 0x7ff3b81339b0 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bf632700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8135b50 con 0x7ff3b813ea20 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bd3ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3b81335d0 0x7ff3b8136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bcbcd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81339b0 0x7ff3b80a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60456/0 (socket says 172.21.15.31:60456) 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 -- 172.21.15.31:0/1348476850 learned_addr learned my addr 172.21.15.31:0/1348476850 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bd3ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3b81335d0 0x7ff3b8136c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54182/0 (socket says 172.21.15.31:54182) 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 -- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81339b0 msgr2=0x7ff3b80a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81339b0 0x7ff3b80a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 -- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3b81335d0 msgr2=0x7ff3b8136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3b81335d0 0x7ff3b8136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 -- 172.21.15.31:0/1348476850 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0009470 con 0x7ff3b813ea20 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bd3ce700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3b81335d0 0x7ff3b8136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bcbcd700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81339b0 0x7ff3b80a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.662+0000 7ff3bdbcf700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8148fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff3b000c000 tx=0x7ff3b00091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.663+0000 7ff3aa7fc700 1 -- 172.21.15.31:0/1348476850 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b0009750 con 0x7ff3b813ea20 2024-04-26T07:28:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.663+0000 7ff3aa7fc700 1 -- 172.21.15.31:0/1348476850 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b000c850 con 0x7ff3b813ea20 2024-04-26T07:28:53.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.663+0000 7ff3aa7fc700 1 -- 172.21.15.31:0/1348476850 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b000cbb0 con 0x7ff3b813ea20 2024-04-26T07:28:53.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.663+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac00b180 con 0x7ff3b813ea20 2024-04-26T07:28:53.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.663+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b80a7c30 con 0x7ff3b813ea20 2024-04-26T07:28:53.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.663+0000 7ff3aa7fc700 1 -- 172.21.15.31:0/1348476850 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff3b0022070 con 0x7ff3b813ea20 2024-04-26T07:28:53.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.664+0000 7ff3aa7fc700 1 -- 172.21.15.31:0/1348476850 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff3b004af00 con 0x7ff3b813ea20 2024-04-26T07:28:53.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.664+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b809f700 con 0x7ff3b813ea20 2024-04-26T07:28:53.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.667+0000 7ff3aa7fc700 1 -- 172.21.15.31:0/1348476850 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff3b809f700 con 0x7ff3b813ea20 2024-04-26T07:28:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.818+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3b809f6d0 con 0x7ff3b813ea20 2024-04-26T07:28:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.818+0000 7ff3aa7fc700 1 -- 172.21.15.31:0/1348476850 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2320 (secure 0 0 0) 0x7ff3b0016030 con 0x7ff3b813ea20 2024-04-26T07:28:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:53.819 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:34.834435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:28:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 >> v1:172.21.15.31:6816/39613 conn(0x7ff398038e30 legacy=0x7ff39803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 msgr2=0x7ff3b8148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8148fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff3b000c000 tx=0x7ff3b00091d0).stop 2024-04-26T07:28:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 shutdown_connections 2024-04-26T07:28:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff3b813ea20 0x7ff3b8148fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3b81335d0 0x7ff3b8136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 --2- 172.21.15.31:0/1348476850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3b81339b0 0x7ff3b80a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 >> 172.21.15.31:0/1348476850 conn(0x7ff3b8060ee0 msgr2=0x7ff3b8067730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 shutdown_connections 2024-04-26T07:28:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.820+0000 7ff3bf632700 1 -- 172.21.15.31:0/1348476850 wait complete. 2024-04-26T07:28:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 9 2024-04-26T07:28:53.830 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:28:53.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.938+0000 7f3865b73700 1 Processor -- start 2024-04-26T07:28:53.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.938+0000 7f3865b73700 1 -- start start 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f3865b73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38601335d0 0x7f38600679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f3865b73700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f386013ea20 0x7f3860140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f3865b73700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3860067ec0 con 0x7f38601339b0 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f3865b73700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600670c0 con 0x7f38601335d0 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f3865b73700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3860066600 con 0x7f386013ea20 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38601335d0 0x7f38600679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f38601339b0 0x7f38600a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56056/0 (socket says 172.21.15.31:56056) 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385effd700 1 -- 172.21.15.31:0/2882720911 learned_addr learned my addr 172.21.15.31:0/2882720911 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385ffff700 1 --2- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f386013ea20 0x7f3860140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385e7fc700 1 -- 172.21.15.31:0/2882720911 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137254745 0 0) 0x7f3860067ec0 con 0x7f38601339b0 2024-04-26T07:28:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385f7fe700 1 -- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f386013ea20 msgr2=0x7f3860140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385f7fe700 1 --2- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f386013ea20 0x7f3860140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385f7fe700 1 -- 172.21.15.31:0/2882720911 >> v1:172.21.15.31:6789/0 conn(0x7f38601339b0 legacy=0x7f38600a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385f7fe700 1 -- 172.21.15.31:0/2882720911 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860066de0 con 0x7f38601335d0 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385ffff700 1 --2- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f386013ea20 0x7f3860140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385f7fe700 1 --2- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38601335d0 0x7f38600679d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f3850002f70 tx=0x7f3850006df0).ready entity=mon.1 client_cookie=d7b37b0031d63d64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385e7fc700 1 -- 172.21.15.31:0/2882720911 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385000d570 con 0x7f38601335d0 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385e7fc700 1 -- 172.21.15.31:0/2882720911 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850000e90 con 0x7f38601335d0 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.939+0000 7f385e7fc700 1 -- 172.21.15.31:0/2882720911 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385000d8c0 con 0x7f38601335d0 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.940+0000 7f3865b73700 1 -- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38601335d0 msgr2=0x7f38600679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.940+0000 7f3865b73700 1 --2- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38601335d0 0x7f38600679d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f3850002f70 tx=0x7f3850006df0).stop 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.940+0000 7f3865b73700 1 -- 172.21.15.31:0/2882720911 shutdown_connections 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.940+0000 7f3865b73700 1 --2- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f386013ea20 0x7f3860140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.940+0000 7f3865b73700 1 --2- 172.21.15.31:0/2882720911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f38601335d0 0x7f38600679d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.940+0000 7f3865b73700 1 -- 172.21.15.31:0/2882720911 >> 172.21.15.31:0/2882720911 conn(0x7f3860060ee0 msgr2=0x7f38600a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:53.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.940+0000 7f3865b73700 1 -- 172.21.15.31:0/2882720911 shutdown_connections 2024-04-26T07:28:53.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.940+0000 7f3865b73700 1 -- 172.21.15.31:0/2882720911 wait complete. 2024-04-26T07:28:53.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.941+0000 7f3865b73700 1 Processor -- start 2024-04-26T07:28:53.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.941+0000 7f3865b73700 1 -- start start 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f3865b73700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f38601335d0 0x7f3860136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f3865b73700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38601339b0 0x7f38600a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f3865b73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f386013ea20 0x7f3860148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f3865b73700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386009cad0 con 0x7f38601339b0 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f3865b73700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3860135890 con 0x7f386013ea20 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f3865b73700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3860135b50 con 0x7f38601335d0 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f386013ea20 0x7f3860148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38601339b0 0x7f38600a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f386013ea20 0x7f3860148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46396/0 (socket says 172.21.15.31:46396) 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38601339b0 0x7f38600a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54184/0 (socket says 172.21.15.31:54184) 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 -- 172.21.15.31:0/264832261 learned_addr learned my addr 172.21.15.31:0/264832261 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385f7fe700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f38601335d0 0x7f3860136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 -- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f38601335d0 msgr2=0x7f3860136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f38601335d0 0x7f3860136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 -- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38601339b0 msgr2=0x7f38600a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38601339b0 0x7f38600a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 -- 172.21.15.31:0/264832261 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009470 con 0x7f386013ea20 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385f7fe700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f38601335d0 0x7f3860136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385effd700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38601339b0 0x7f38600a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385ffff700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f386013ea20 0x7f3860148fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f385800c000 tx=0x7f38580091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385cff9700 1 -- 172.21.15.31:0/264832261 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3858009750 con 0x7f386013ea20 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385cff9700 1 -- 172.21.15.31:0/264832261 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385800c850 con 0x7f386013ea20 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385000b180 con 0x7f386013ea20 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f385cff9700 1 -- 172.21.15.31:0/264832261 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385800cbb0 con 0x7f386013ea20 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.942+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38600a7c30 con 0x7f386013ea20 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.943+0000 7f385cff9700 1 -- 172.21.15.31:0/264832261 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3858022070 con 0x7f386013ea20 2024-04-26T07:28:53.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.943+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386009f700 con 0x7f386013ea20 2024-04-26T07:28:53.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.944+0000 7f385cff9700 1 -- 172.21.15.31:0/264832261 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f385804af00 con 0x7f386013ea20 2024-04-26T07:28:53.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:53.947+0000 7f385cff9700 1 -- 172.21.15.31:0/264832261 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f386009f700 con 0x7f386013ea20 2024-04-26T07:28:54.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.064+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f386009f6d0 con 0x7f386013ea20 2024-04-26T07:28:54.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.065+0000 7f385cff9700 1 -- 172.21.15.31:0/264832261 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7f3858016020 con 0x7f386013ea20 2024-04-26T07:28:54.067 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:54.067 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:45.886508+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:28:54.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 >> v1:172.21.15.31:6816/39613 conn(0x7f3840038e30 legacy=0x7f384003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:54.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f386013ea20 msgr2=0x7f3860148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:54.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f386013ea20 0x7f3860148fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f385800c000 tx=0x7f38580091d0).stop 2024-04-26T07:28:54.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 shutdown_connections 2024-04-26T07:28:54.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f38601335d0 0x7f3860136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f386013ea20 0x7f3860148fe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 --2- 172.21.15.31:0/264832261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38601339b0 0x7f38600a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 >> 172.21.15.31:0/264832261 conn(0x7f3860060ee0 msgr2=0x7f3860067730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:54.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 shutdown_connections 2024-04-26T07:28:54.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.067+0000 7f3865b73700 1 -- 172.21.15.31:0/264832261 wait complete. 2024-04-26T07:28:54.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T07:28:54.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.190+0000 7f391d5d0700 1 Processor -- start 2024-04-26T07:28:54.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.190+0000 7f391d5d0700 1 -- start start 2024-04-26T07:28:54.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f391d5d0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f391806c7d0 0x7f39181360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:54.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f391d5d0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3918096320 0x7f391805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:54.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f391d5d0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180970a0 con 0x7f391805be60 2024-04-26T07:28:54.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f391d5d0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3918133c10 con 0x7f391806c7d0 2024-04-26T07:28:54.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f391d5d0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3918136780 con 0x7f3918096320 2024-04-26T07:28:54.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f3916ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f391806c7d0 0x7f39181360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:54.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f39167fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3918096320 0x7f391805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:54.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f3916ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f391806c7d0 0x7f39181360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54200/0 (socket says 172.21.15.31:54200) 2024-04-26T07:28:54.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f39167fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3918096320 0x7f391805b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46402/0 (socket says 172.21.15.31:46402) 2024-04-26T07:28:54.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f3916ffd700 1 -- 172.21.15.31:0/2543573564 learned_addr learned my addr 172.21.15.31:0/2543573564 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:54.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.191+0000 7f39177fe700 1 --1- 172.21.15.31:0/2543573564 >> v1:172.21.15.31:6789/0 conn(0x7f391805be60 0x7f3918140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56058/0 (socket says 172.21.15.31:56058) 2024-04-26T07:28:54.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f39167fc700 1 -- 172.21.15.31:0/2543573564 >> v2:172.21.15.31:3300/0 conn(0x7f391806c7d0 msgr2=0x7f39181360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:54.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f39167fc700 1 --2- 172.21.15.31:0/2543573564 >> v2:172.21.15.31:3300/0 conn(0x7f391806c7d0 0x7f39181360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f39167fc700 1 -- 172.21.15.31:0/2543573564 >> v1:172.21.15.31:6789/0 conn(0x7f391805be60 legacy=0x7f3918140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:54.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f39167fc700 1 -- 172.21.15.31:0/2543573564 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918136a40 con 0x7f3918096320 2024-04-26T07:28:54.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f3916ffd700 1 --2- 172.21.15.31:0/2543573564 >> v2:172.21.15.31:3300/0 conn(0x7f391806c7d0 0x7f39181360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:54.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f39167fc700 1 --2- 172.21.15.31:0/2543573564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3918096320 0x7f391805b970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3908002f70 tx=0x7f3908006df0).ready entity=mon.1 client_cookie=fc5b51c6ad424d84 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:54.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f3915ffb700 1 -- 172.21.15.31:0/2543573564 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f390800d570 con 0x7f3918096320 2024-04-26T07:28:54.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f3915ffb700 1 -- 172.21.15.31:0/2543573564 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908000e90 con 0x7f3918096320 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f3915ffb700 1 -- 172.21.15.31:0/2543573564 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f390800d8c0 con 0x7f3918096320 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f391d5d0700 1 -- 172.21.15.31:0/2543573564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3918096320 msgr2=0x7f391805b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f391d5d0700 1 --2- 172.21.15.31:0/2543573564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3918096320 0x7f391805b970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3908002f70 tx=0x7f3908006df0).stop 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f391d5d0700 1 -- 172.21.15.31:0/2543573564 shutdown_connections 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f391d5d0700 1 --2- 172.21.15.31:0/2543573564 >> v2:172.21.15.31:3300/0 conn(0x7f391806c7d0 0x7f39181360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f391d5d0700 1 --2- 172.21.15.31:0/2543573564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3918096320 0x7f391805b970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.192+0000 7f391d5d0700 1 -- 172.21.15.31:0/2543573564 >> 172.21.15.31:0/2543573564 conn(0x7f3918061370 msgr2=0x7f391806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.193+0000 7f391d5d0700 1 -- 172.21.15.31:0/2543573564 shutdown_connections 2024-04-26T07:28:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.193+0000 7f391d5d0700 1 -- 172.21.15.31:0/2543573564 wait complete. 2024-04-26T07:28:54.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.193+0000 7f391d5d0700 1 Processor -- start 2024-04-26T07:28:54.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.193+0000 7f391d5d0700 1 -- start start 2024-04-26T07:28:54.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f391d5d0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f391805be60 0x7f3918064040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:54.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f391d5d0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f391806c7d0 0x7f3918062000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:54.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f391d5d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3918096320 0x7f39180624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:54.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f391d5d0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180661c0 con 0x7f3918096320 2024-04-26T07:28:54.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f391d5d0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3918065fa0 con 0x7f391806c7d0 2024-04-26T07:28:54.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f391d5d0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3918064700 con 0x7f391805be60 2024-04-26T07:28:54.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f3916ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f391805be60 0x7f3918064040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:54.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39167fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f391806c7d0 0x7f3918062000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:54.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3918096320 0x7f39180624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:54.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f3916ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f391805be60 0x7f3918064040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60490/0 (socket says 172.21.15.31:60490) 2024-04-26T07:28:54.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39167fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f391806c7d0 0x7f3918062000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46416/0 (socket says 172.21.15.31:46416) 2024-04-26T07:28:54.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f3916ffd700 1 -- 172.21.15.31:0/3858890147 learned_addr learned my addr 172.21.15.31:0/3858890147 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39177fe700 1 -- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f391805be60 msgr2=0x7f3918064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39177fe700 1 --2- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f391805be60 0x7f3918064040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39177fe700 1 -- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f391806c7d0 msgr2=0x7f3918062000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39177fe700 1 --2- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f391806c7d0 0x7f3918062000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39177fe700 1 -- 172.21.15.31:0/3858890147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c00b1e0 con 0x7f3918096320 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.194+0000 7f39167fc700 1 --2- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f391806c7d0 0x7f3918062000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.195+0000 7f39177fe700 1 --2- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3918096320 0x7f39180624f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f391806d0b0 tx=0x7f3910007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.195+0000 7f3907fff700 1 -- 172.21.15.31:0/3858890147 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3910005ae0 con 0x7f3918096320 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.195+0000 7f3907fff700 1 -- 172.21.15.31:0/3858890147 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3910005c40 con 0x7f3918096320 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.195+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390800b180 con 0x7f3918096320 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.195+0000 7f3907fff700 1 -- 172.21.15.31:0/3858890147 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39100070d0 con 0x7f3918096320 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.195+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3918063bd0 con 0x7f3918096320 2024-04-26T07:28:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.196+0000 7f3907fff700 1 -- 172.21.15.31:0/3858890147 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3910010070 con 0x7f3918096320 2024-04-26T07:28:54.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.196+0000 7f3907fff700 1 -- 172.21.15.31:0/3858890147 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f391004a030 con 0x7f3918096320 2024-04-26T07:28:54.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.196+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3918066370 con 0x7f3918096320 2024-04-26T07:28:54.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.199+0000 7f3907fff700 1 -- 172.21.15.31:0/3858890147 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f391002ef30 con 0x7f3918096320 2024-04-26T07:28:54.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.352+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f39180975a0 con 0x7f3918096320 2024-04-26T07:28:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.921+0000 7f3907fff700 1 -- 172.21.15.31:0/3858890147 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3910032550 con 0x7f3918096320 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.922+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 >> v1:172.21.15.31:6816/39613 conn(0x7f38f4038da0 legacy=0x7f38f403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.922+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3918096320 msgr2=0x7f39180624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.922+0000 7f391d5d0700 1 --2- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3918096320 0x7f39180624f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f391806d0b0 tx=0x7f3910007e80).stop 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.923+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 shutdown_connections 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.923+0000 7f391d5d0700 1 --2- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f391805be60 0x7f3918064040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.923+0000 7f391d5d0700 1 --2- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3918096320 0x7f39180624f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.923+0000 7f391d5d0700 1 --2- 172.21.15.31:0/3858890147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f391806c7d0 0x7f3918062000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.923+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 >> 172.21.15.31:0/3858890147 conn(0x7f3918061370 msgr2=0x7f391809b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.923+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 shutdown_connections 2024-04-26T07:28:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:54.923+0000 7f391d5d0700 1 -- 172.21.15.31:0/3858890147 wait complete. 2024-04-26T07:28:54.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-04-26T07:28:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.052+0000 7f8b1bcb6700 1 Processor -- start 2024-04-26T07:28:55.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.052+0000 7f8b1bcb6700 1 -- start start 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b1bcb6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8b14065280 0x7f8b140635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b1bcb6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14063aa0 0x7f8b1413e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b1bcb6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1409c5e0 con 0x7f8b14134460 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b1bcb6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b14134240 con 0x7f8b14065280 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b1bcb6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140656f0 con 0x7f8b14063aa0 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b19251700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8b14065280 0x7f8b140635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b19a52700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8b14134460 0x7f8b14134840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56060/0 (socket says 172.21.15.31:56060) 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b19a52700 1 -- 172.21.15.31:0/1731133912 learned_addr learned my addr 172.21.15.31:0/1731133912 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b1a253700 1 --2- 172.21.15.31:0/1731133912 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14063aa0 0x7f8b1413e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b19251700 1 -- 172.21.15.31:0/1731133912 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14063aa0 msgr2=0x7f8b1413e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b19251700 1 --2- 172.21.15.31:0/1731133912 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14063aa0 0x7f8b1413e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:55.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b19251700 1 -- 172.21.15.31:0/1731133912 >> v1:172.21.15.31:6789/0 conn(0x7f8b14134460 legacy=0x7f8b14134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b19251700 1 -- 172.21.15.31:0/1731133912 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1409bb10 con 0x7f8b14065280 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.053+0000 7f8b18a50700 1 -- 172.21.15.31:0/1731133912 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516353023 0 0) 0x7f8b1409c5e0 con 0x7f8b14134460 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b19251700 1 --2- 172.21.15.31:0/1731133912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 0x7f8b140635b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f8b08002f70 tx=0x7f8b08006df0).ready entity=mon.0 client_cookie=5ed0618c8a28c19d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b18a50700 1 -- 172.21.15.31:0/1731133912 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0800d570 con 0x7f8b14065280 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b18a50700 1 -- 172.21.15.31:0/1731133912 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b08000e90 con 0x7f8b14065280 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b18a50700 1 -- 172.21.15.31:0/1731133912 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0800d8c0 con 0x7f8b14065280 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1731133912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 msgr2=0x7f8b140635b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b1bcb6700 1 --2- 172.21.15.31:0/1731133912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 0x7f8b140635b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f8b08002f70 tx=0x7f8b08006df0).stop 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1731133912 shutdown_connections 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b1bcb6700 1 --2- 172.21.15.31:0/1731133912 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14063aa0 0x7f8b1413e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:55.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b1bcb6700 1 --2- 172.21.15.31:0/1731133912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 0x7f8b140635b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:55.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1731133912 >> 172.21.15.31:0/1731133912 conn(0x7f8b1405cfb0 msgr2=0x7f8b14062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:55.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1731133912 shutdown_connections 2024-04-26T07:28:55.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.054+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1731133912 wait complete. 2024-04-26T07:28:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.055+0000 7f8b1bcb6700 1 Processor -- start 2024-04-26T07:28:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.055+0000 7f8b1bcb6700 1 -- start start 2024-04-26T07:28:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1bcb6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b14063aa0 0x7f8b14095290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1bcb6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 0x7f8b14092ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1bcb6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14134460 0x7f8b14093390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1bcb6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14095950 con 0x7f8b14065280 2024-04-26T07:28:55.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1bcb6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14095c10 con 0x7f8b14134460 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1bcb6700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14097650 con 0x7f8b14063aa0 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b19251700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 0x7f8b14092ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1a253700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14134460 0x7f8b14093390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b19251700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 0x7f8b14092ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54224/0 (socket says 172.21.15.31:54224) 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b19251700 1 -- 172.21.15.31:0/1730606328 learned_addr learned my addr 172.21.15.31:0/1730606328 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b19a52700 1 --2- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b14063aa0 0x7f8b14095290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1a253700 1 -- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b14063aa0 msgr2=0x7f8b14095290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1a253700 1 --2- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b14063aa0 0x7f8b14095290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1a253700 1 -- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 msgr2=0x7f8b14092ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1a253700 1 --2- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 0x7f8b14092ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1a253700 1 -- 172.21.15.31:0/1730606328 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0800b180 con 0x7f8b14134460 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b1a253700 1 --2- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14134460 0x7f8b14093390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8b0c00c000 tx=0x7f8b0c0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:55.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.056+0000 7f8b06ffd700 1 -- 172.21.15.31:0/1730606328 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0c012600 con 0x7f8b14134460 2024-04-26T07:28:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.057+0000 7f8b06ffd700 1 -- 172.21.15.31:0/1730606328 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c012760 con 0x7f8b14134460 2024-04-26T07:28:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.057+0000 7f8b06ffd700 1 -- 172.21.15.31:0/1730606328 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0c012ac0 con 0x7f8b14134460 2024-04-26T07:28:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.057+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b140942d0 con 0x7f8b14134460 2024-04-26T07:28:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.057+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b141335a0 con 0x7f8b14134460 2024-04-26T07:28:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.057+0000 7f8b06ffd700 1 -- 172.21.15.31:0/1730606328 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8b0c022070 con 0x7f8b14134460 2024-04-26T07:28:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.058+0000 7f8b06ffd700 1 -- 172.21.15.31:0/1730606328 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8b0c04ae20 con 0x7f8b14134460 2024-04-26T07:28:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.058+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b140950d0 con 0x7f8b14134460 2024-04-26T07:28:55.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.061+0000 7f8b06ffd700 1 -- 172.21.15.31:0/1730606328 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8b140950d0 con 0x7f8b14134460 2024-04-26T07:28:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.214+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f8b140950d0 con 0x7f8b14134460 2024-04-26T07:28:55.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.926+0000 7f8b06ffd700 1 -- 172.21.15.31:0/1730606328 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v11) v1 ==== 105+0+0 (secure 0 0 0) 0x7f8b140950d0 con 0x7f8b14134460 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 >> v1:172.21.15.31:6816/39613 conn(0x7f8af4038dd0 legacy=0x7f8af403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14134460 msgr2=0x7f8b14093390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 --2- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14134460 0x7f8b14093390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8b0c00c000 tx=0x7f8b0c0091d0).stop 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 shutdown_connections 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 --2- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b14063aa0 0x7f8b14095290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 --2- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b14134460 0x7f8b14093390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 --2- 172.21.15.31:0/1730606328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b14065280 0x7f8b14092ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 >> 172.21.15.31:0/1730606328 conn(0x7f8b1405cfb0 msgr2=0x7f8b1406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.928+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 shutdown_connections 2024-04-26T07:28:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:55.929+0000 7f8b1bcb6700 1 -- 172.21.15.31:0/1730606328 wait complete. 2024-04-26T07:28:55.942 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:56.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.055+0000 7eff020ac700 1 Processor -- start 2024-04-26T07:28:56.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.055+0000 7eff020ac700 1 -- start start 2024-04-26T07:28:56.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7eff020ac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc0679d0 0x7efefc1339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:56.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7eff020ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc13ea20 0x7efefc140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:56.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7eff020ac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efefc133ea0 con 0x7efefc1335d0 2024-04-26T07:28:56.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7eff020ac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efefc0670c0 con 0x7efefc13ea20 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7eff020ac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efefc066600 con 0x7efefc0679d0 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefaffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc0679d0 0x7efefc1339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc13ea20 0x7efefc140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefb7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efefc1335d0 0x7efefc0a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56068/0 (socket says 172.21.15.31:56068) 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefb7fe700 1 -- 172.21.15.31:0/2998941128 learned_addr learned my addr 172.21.15.31:0/2998941128 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefa7fc700 1 -- 172.21.15.31:0/2998941128 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373477668 0 0) 0x7efefc133ea0 con 0x7efefc1335d0 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefaffd700 1 -- 172.21.15.31:0/2998941128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc13ea20 msgr2=0x7efefc140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefaffd700 1 --2- 172.21.15.31:0/2998941128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc13ea20 0x7efefc140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefaffd700 1 -- 172.21.15.31:0/2998941128 >> v1:172.21.15.31:6789/0 conn(0x7efefc1335d0 legacy=0x7efefc0a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefaffd700 1 -- 172.21.15.31:0/2998941128 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc066de0 con 0x7efefc0679d0 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefbfff700 1 --2- 172.21.15.31:0/2998941128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc13ea20 0x7efefc140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:56.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefaffd700 1 --2- 172.21.15.31:0/2998941128 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc0679d0 0x7efefc1339b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efeec002f70 tx=0x7efeec006df0).ready entity=mon.2 client_cookie=544119c72b03a58b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefa7fc700 1 -- 172.21.15.31:0/2998941128 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeec00d570 con 0x7efefc0679d0 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefa7fc700 1 -- 172.21.15.31:0/2998941128 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec000e90 con 0x7efefc0679d0 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.056+0000 7efefa7fc700 1 -- 172.21.15.31:0/2998941128 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeec00d8c0 con 0x7efefc0679d0 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.057+0000 7eff020ac700 1 -- 172.21.15.31:0/2998941128 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc0679d0 msgr2=0x7efefc1339b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.057+0000 7eff020ac700 1 --2- 172.21.15.31:0/2998941128 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc0679d0 0x7efefc1339b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efeec002f70 tx=0x7efeec006df0).stop 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.057+0000 7eff020ac700 1 -- 172.21.15.31:0/2998941128 shutdown_connections 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.057+0000 7eff020ac700 1 --2- 172.21.15.31:0/2998941128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc13ea20 0x7efefc140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.057+0000 7eff020ac700 1 --2- 172.21.15.31:0/2998941128 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc0679d0 0x7efefc1339b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.057+0000 7eff020ac700 1 -- 172.21.15.31:0/2998941128 >> 172.21.15.31:0/2998941128 conn(0x7efefc060ee0 msgr2=0x7efefc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.057+0000 7eff020ac700 1 -- 172.21.15.31:0/2998941128 shutdown_connections 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.057+0000 7eff020ac700 1 -- 172.21.15.31:0/2998941128 wait complete. 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.058+0000 7eff020ac700 1 Processor -- start 2024-04-26T07:28:56.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.058+0000 7eff020ac700 1 -- start start 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7eff020ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc0679d0 0x7efefc135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7eff020ac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efefc1335d0 0x7efefc149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7eff020ac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc13ea20 0x7efefc149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7eff020ac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc0a1b90 con 0x7efefc1335d0 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7eff020ac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efefc0a1e50 con 0x7efefc0679d0 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7eff020ac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efefc1345a0 con 0x7efefc13ea20 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc0679d0 0x7efefc135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efefc1335d0 0x7efefc149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc0679d0 0x7efefc135180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46438/0 (socket says 172.21.15.31:46438) 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efefc1335d0 0x7efefc149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54236/0 (socket says 172.21.15.31:54236) 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 -- 172.21.15.31:0/2623223873 learned_addr learned my addr 172.21.15.31:0/2623223873 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefbfff700 1 --2- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc13ea20 0x7efefc149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:56.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 -- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc13ea20 msgr2=0x7efefc149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 --2- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc13ea20 0x7efefc149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 -- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efefc1335d0 msgr2=0x7efefc149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 --2- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efefc1335d0 0x7efefc149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 -- 172.21.15.31:0/2623223873 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4009470 con 0x7efefc0679d0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efefb7fe700 1 --2- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc0679d0 0x7efefc135180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7efee4000bc0 tx=0x7efee4007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efef8ff9700 1 -- 172.21.15.31:0/2623223873 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee40070d0 con 0x7efefc0679d0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efef8ff9700 1 -- 172.21.15.31:0/2623223873 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4007230 con 0x7efefc0679d0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec00b180 con 0x7efefc0679d0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7efef8ff9700 1 -- 172.21.15.31:0/2623223873 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee4005610 con 0x7efefc0679d0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.059+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc0a81f0 con 0x7efefc0679d0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.060+0000 7efef8ff9700 1 -- 172.21.15.31:0/2623223873 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7efee401a060 con 0x7efefc0679d0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.060+0000 7efef8ff9700 1 -- 172.21.15.31:0/2623223873 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efee4049f90 con 0x7efefc0679d0 2024-04-26T07:28:56.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.061+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efefc065ba0 con 0x7efefc0679d0 2024-04-26T07:28:56.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.064+0000 7efef8ff9700 1 -- 172.21.15.31:0/2623223873 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7efee4018080 con 0x7efefc0679d0 2024-04-26T07:28:56.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.212+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efefc06bbc0 con 0x7efefc0679d0 2024-04-26T07:28:56.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.213+0000 7efef8ff9700 1 -- 172.21.15.31:0/2623223873 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7efee402ee90 con 0x7efefc0679d0 2024-04-26T07:28:56.213 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:56.213 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:28:56.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 >> v1:172.21.15.31:6816/39613 conn(0x7efee0038da0 legacy=0x7efee003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc0679d0 msgr2=0x7efefc135180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 --2- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc0679d0 0x7efefc135180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7efee4000bc0 tx=0x7efee4007c90).stop 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 shutdown_connections 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 --2- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efefc13ea20 0x7efefc149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 --2- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efefc0679d0 0x7efefc135180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 --2- 172.21.15.31:0/2623223873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efefc1335d0 0x7efefc149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 >> 172.21.15.31:0/2623223873 conn(0x7efefc060ee0 msgr2=0x7efefc138a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 shutdown_connections 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:56.214+0000 7eff020ac700 1 -- 172.21.15.31:0/2623223873 wait complete. 2024-04-26T07:28:56.215 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:28:56.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:28:56.528 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:28:57.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7ce375700 1 Processor -- start 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7ce375700 1 -- start start 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7ce375700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7c8137a50 0x7ff7c8137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7ce375700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c809ff30 0x7ff7c80a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7ce375700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c8137620 con 0x7ff7c80a3740 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7ce375700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80a4e20 con 0x7ff7c8137a50 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7ce375700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8138320 con 0x7ff7c809ff30 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7c7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7c8137a50 0x7ff7c8137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:57.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7c77fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c809ff30 0x7ff7c80a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7cc912700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff7c80a3740 0x7ff7c805b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59310/0 (socket says 172.21.15.31:59310) 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.649+0000 7ff7cc912700 1 -- 172.21.15.31:0/1815398743 learned_addr learned my addr 172.21.15.31:0/1815398743 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c7fff700 1 -- 172.21.15.31:0/1815398743 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c809ff30 msgr2=0x7ff7c80a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c7fff700 1 --2- 172.21.15.31:0/1815398743 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c809ff30 0x7ff7c80a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c7fff700 1 -- 172.21.15.31:0/1815398743 >> v1:172.21.15.31:6789/0 conn(0x7ff7c80a3740 legacy=0x7ff7c805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c6ffd700 1 -- 172.21.15.31:0/1815398743 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089616041 0 0) 0x7ff7c8137620 con 0x7ff7c80a3740 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c7fff700 1 -- 172.21.15.31:0/1815398743 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80a46a0 con 0x7ff7c8137a50 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c7fff700 1 --2- 172.21.15.31:0/1815398743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c8137a50 0x7ff7c8137e30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7ff7b8002f70 tx=0x7ff7b8006df0).ready entity=mon.0 client_cookie=c9cda3469003f44 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c6ffd700 1 -- 172.21.15.31:0/1815398743 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b800d570 con 0x7ff7c8137a50 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c6ffd700 1 -- 172.21.15.31:0/1815398743 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8000e90 con 0x7ff7c8137a50 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.650+0000 7ff7c6ffd700 1 -- 172.21.15.31:0/1815398743 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b800d8c0 con 0x7ff7c8137a50 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.651+0000 7ff7ce375700 1 -- 172.21.15.31:0/1815398743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c8137a50 msgr2=0x7ff7c8137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.651+0000 7ff7ce375700 1 --2- 172.21.15.31:0/1815398743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c8137a50 0x7ff7c8137e30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7ff7b8002f70 tx=0x7ff7b8006df0).stop 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.651+0000 7ff7ce375700 1 -- 172.21.15.31:0/1815398743 shutdown_connections 2024-04-26T07:28:57.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.651+0000 7ff7ce375700 1 --2- 172.21.15.31:0/1815398743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c8137a50 0x7ff7c8137e30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:57.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.651+0000 7ff7ce375700 1 --2- 172.21.15.31:0/1815398743 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c809ff30 0x7ff7c80a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:57.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.651+0000 7ff7ce375700 1 -- 172.21.15.31:0/1815398743 >> 172.21.15.31:0/1815398743 conn(0x7ff7c8060ee0 msgr2=0x7ff7c80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:57.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.651+0000 7ff7ce375700 1 -- 172.21.15.31:0/1815398743 shutdown_connections 2024-04-26T07:28:57.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.651+0000 7ff7ce375700 1 -- 172.21.15.31:0/1815398743 wait complete. 2024-04-26T07:28:57.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.652+0000 7ff7ce375700 1 Processor -- start 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.652+0000 7ff7ce375700 1 -- start start 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.652+0000 7ff7ce375700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c809ff30 0x7ff7c8065cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.652+0000 7ff7ce375700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7c80a3740 0x7ff7c8133490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.652+0000 7ff7ce375700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c8137a50 0x7ff7c8133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7ce375700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80651c0 con 0x7ff7c809ff30 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7ce375700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80653f0 con 0x7ff7c80a3740 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7ce375700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80647a0 con 0x7ff7c8137a50 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c809ff30 0x7ff7c8065cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7cc912700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c8137a50 0x7ff7c8133980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c809ff30 0x7ff7c8065cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54290/0 (socket says 172.21.15.31:54290) 2024-04-26T07:28:57.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 -- 172.21.15.31:0/631583829 learned_addr learned my addr 172.21.15.31:0/631583829 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c77fe700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7c80a3740 0x7ff7c8133490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 -- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c8137a50 msgr2=0x7ff7c8133980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c8137a50 0x7ff7c8133980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 -- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7c80a3740 msgr2=0x7ff7c8133490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7c80a3740 0x7ff7c8133490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 -- 172.21.15.31:0/631583829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b800b180 con 0x7ff7c809ff30 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c77fe700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7c80a3740 0x7ff7c8133490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c7fff700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c809ff30 0x7ff7c8065cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff7b8002f70 tx=0x7ff7b8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c57fa700 1 -- 172.21.15.31:0/631583829 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b800dea0 con 0x7ff7c809ff30 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c57fa700 1 -- 172.21.15.31:0/631583829 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b801e400 con 0x7ff7c809ff30 2024-04-26T07:28:57.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c8064a60 con 0x7ff7c809ff30 2024-04-26T07:28:57.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7c57fa700 1 -- 172.21.15.31:0/631583829 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b801e760 con 0x7ff7c809ff30 2024-04-26T07:28:57.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.653+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c8133e70 con 0x7ff7c809ff30 2024-04-26T07:28:57.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.654+0000 7ff7c57fa700 1 -- 172.21.15.31:0/631583829 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff7b8025030 con 0x7ff7c809ff30 2024-04-26T07:28:57.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.654+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c80a0350 con 0x7ff7c809ff30 2024-04-26T07:28:57.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.654+0000 7ff7c57fa700 1 -- 172.21.15.31:0/631583829 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff7b804b590 con 0x7ff7c809ff30 2024-04-26T07:28:57.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.658+0000 7ff7c57fa700 1 -- 172.21.15.31:0/631583829 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff7b8028440 con 0x7ff7c809ff30 2024-04-26T07:28:57.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.805+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7c806bbc0 con 0x7ff7c809ff30 2024-04-26T07:28:57.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.805+0000 7ff7c57fa700 1 -- 172.21.15.31:0/631583829 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7ff7b8023030 con 0x7ff7c809ff30 2024-04-26T07:28:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:28:57.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 >> v1:172.21.15.31:6816/39613 conn(0x7ff7a8038ec0 legacy=0x7ff7a803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:57.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c809ff30 msgr2=0x7ff7c8065cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:57.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c809ff30 0x7ff7c8065cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff7b8002f70 tx=0x7ff7b8014000).stop 2024-04-26T07:28:57.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 shutdown_connections 2024-04-26T07:28:57.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7c8137a50 0x7ff7c8133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:57.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c809ff30 0x7ff7c8065cd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:57.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 --2- 172.21.15.31:0/631583829 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7c80a3740 0x7ff7c8133490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:57.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 >> 172.21.15.31:0/631583829 conn(0x7ff7c8060ee0 msgr2=0x7ff7c805c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:57.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 shutdown_connections 2024-04-26T07:28:57.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:57.807+0000 7ff7ce375700 1 -- 172.21.15.31:0/631583829 wait complete. 2024-04-26T07:28:57.808 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:28:58.120 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:28:58.120 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:28:59.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:28:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f1756102700 1 Processor -- start 2024-04-26T07:28:59.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f1756102700 1 -- start start 2024-04-26T07:28:59.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f1756102700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175006c990 0x7f1750136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f1756102700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17500648b0 0x7f1750136c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f1756102700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175006cd70 con 0x7f1750133340 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f1756102700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1750132eb0 con 0x7f17500648b0 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f1756102700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1750063c00 con 0x7f175006c990 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f174effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17500648b0 0x7f1750136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175006c990 0x7f1750136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f174effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17500648b0 0x7f1750136c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54292/0 (socket says 172.21.15.31:54292) 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175006c990 0x7f1750136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47798/0 (socket says 172.21.15.31:47798) 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.242+0000 7f174ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1750133340 0x7f17501337a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59312/0 (socket says 172.21.15.31:59312) 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174effd700 1 -- 172.21.15.31:0/1297025483 learned_addr learned my addr 172.21.15.31:0/1297025483 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174effd700 1 -- 172.21.15.31:0/1297025483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175006c990 msgr2=0x7f1750136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174effd700 1 --2- 172.21.15.31:0/1297025483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175006c990 0x7f1750136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174effd700 1 -- 172.21.15.31:0/1297025483 >> v1:172.21.15.31:6789/0 conn(0x7f1750133340 legacy=0x7f17501337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174e7fc700 1 -- 172.21.15.31:0/1297025483 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661131047 0 0) 0x7f175006cd70 con 0x7f1750133340 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174effd700 1 -- 172.21.15.31:0/1297025483 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17501330a0 con 0x7f17500648b0 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174f7fe700 1 --2- 172.21.15.31:0/1297025483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175006c990 0x7f1750136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174effd700 1 --2- 172.21.15.31:0/1297025483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750136c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f1738002f70 tx=0x7f1738006eb0).ready entity=mon.0 client_cookie=3326f9703ae963ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174e7fc700 1 -- 172.21.15.31:0/1297025483 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f173800d570 con 0x7f17500648b0 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174e7fc700 1 -- 172.21.15.31:0/1297025483 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1738000e90 con 0x7f17500648b0 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.243+0000 7f174e7fc700 1 -- 172.21.15.31:0/1297025483 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f173800d8c0 con 0x7f17500648b0 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.244+0000 7f1756102700 1 -- 172.21.15.31:0/1297025483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 msgr2=0x7f1750136c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.244+0000 7f1756102700 1 --2- 172.21.15.31:0/1297025483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750136c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f1738002f70 tx=0x7f1738006eb0).stop 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.244+0000 7f1756102700 1 -- 172.21.15.31:0/1297025483 shutdown_connections 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.244+0000 7f1756102700 1 --2- 172.21.15.31:0/1297025483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175006c990 0x7f1750136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.244+0000 7f1756102700 1 --2- 172.21.15.31:0/1297025483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750136c30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.244+0000 7f1756102700 1 -- 172.21.15.31:0/1297025483 >> 172.21.15.31:0/1297025483 conn(0x7f1750061370 msgr2=0x7f175006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.244+0000 7f1756102700 1 -- 172.21.15.31:0/1297025483 shutdown_connections 2024-04-26T07:28:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.244+0000 7f1756102700 1 -- 172.21.15.31:0/1297025483 wait complete. 2024-04-26T07:28:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.245+0000 7f1756102700 1 Processor -- start 2024-04-26T07:28:59.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.245+0000 7f1756102700 1 -- start start 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.245+0000 7f1756102700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750067960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f1756102700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175006c990 0x7f1750098720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f1756102700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1750133340 0x7f1750096320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f1756102700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750097af0 con 0x7f17500648b0 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f1756102700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175009e000 con 0x7f1750133340 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f1756102700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f175009e260 con 0x7f175006c990 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750067960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750067960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54302/0 (socket says 172.21.15.31:54302) 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 -- 172.21.15.31:0/3148582443 learned_addr learned my addr 172.21.15.31:0/3148582443 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174ffff700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1750133340 0x7f1750096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174effd700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175006c990 0x7f1750098720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 -- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175006c990 msgr2=0x7f1750098720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175006c990 0x7f1750098720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 -- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1750133340 msgr2=0x7f1750096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1750133340 0x7f1750096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 -- 172.21.15.31:0/3148582443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174000b710 con 0x7f17500648b0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174ffff700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1750133340 0x7f1750096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174f7fe700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750067960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f174000e000 tx=0x7f174000b470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174cff9700 1 -- 172.21.15.31:0/3148582443 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f174000dd30 con 0x7f17500648b0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174cff9700 1 -- 172.21.15.31:0/3148582443 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174000de90 con 0x7f17500648b0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173800b1e0 con 0x7f17500648b0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f174cff9700 1 -- 172.21.15.31:0/3148582443 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1740010630 con 0x7f17500648b0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.246+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175009d0f0 con 0x7f17500648b0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.247+0000 7f174cff9700 1 -- 172.21.15.31:0/3148582443 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1740020070 con 0x7f17500648b0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.247+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175006bbc0 con 0x7f17500648b0 2024-04-26T07:28:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.248+0000 7f174cff9700 1 -- 172.21.15.31:0/3148582443 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f174004b450 con 0x7f17500648b0 2024-04-26T07:28:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.251+0000 7f174cff9700 1 -- 172.21.15.31:0/3148582443 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1740030240 con 0x7f17500648b0 2024-04-26T07:28:59.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.399+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1750064dd0 con 0x7f17500648b0 2024-04-26T07:28:59.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.399+0000 7f174cff9700 1 -- 172.21.15.31:0/3148582443 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f1740033860 con 0x7f17500648b0 2024-04-26T07:28:59.402 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:28:59.402 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.400+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 >> v1:172.21.15.31:6816/39613 conn(0x7f1734038f50 legacy=0x7f173403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.400+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 msgr2=0x7f1750067960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.400+0000 7f1756102700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750067960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f174000e000 tx=0x7f174000b470).stop 2024-04-26T07:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.401+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 shutdown_connections 2024-04-26T07:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.401+0000 7f1756102700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1750133340 0x7f1750096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.401+0000 7f1756102700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17500648b0 0x7f1750067960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.401+0000 7f1756102700 1 --2- 172.21.15.31:0/3148582443 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175006c990 0x7f1750098720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.401+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 >> 172.21.15.31:0/3148582443 conn(0x7f1750061370 msgr2=0x7f17500a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.401+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 shutdown_connections 2024-04-26T07:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:28:59.401+0000 7f1756102700 1 -- 172.21.15.31:0/3148582443 wait complete. 2024-04-26T07:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:28:59.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:28:59.714 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:00.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:00.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.835+0000 7f54e9668700 1 Processor -- start 2024-04-26T07:29:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.835+0000 7f54e9668700 1 -- start start 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e9668700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e406c7d0 0x7f54e41360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e9668700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e405c080 0x7f54e4141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e9668700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e40970a0 con 0x7f54e4096320 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e9668700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4133c10 con 0x7f54e405c080 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e9668700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4136780 con 0x7f54e406c7d0 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e2ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e406c7d0 0x7f54e41360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e405c080 0x7f54e4141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e2ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e406c7d0 0x7f54e41360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:56362/0 (socket says 172.21.15.31:56362) 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e27fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f54e4096320 0x7f54e405b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59320/0 (socket says 172.21.15.31:59320) 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e405c080 0x7f54e4141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47818/0 (socket says 172.21.15.31:47818) 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.836+0000 7f54e2ffd700 1 -- 172.21.15.31:0/1292685156 learned_addr learned my addr 172.21.15.31:0/1292685156 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e2ffd700 1 -- 172.21.15.31:0/1292685156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e405c080 msgr2=0x7f54e4141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:00.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e2ffd700 1 --2- 172.21.15.31:0/1292685156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e405c080 0x7f54e4141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e1ffb700 1 -- 172.21.15.31:0/1292685156 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224249347 0 0) 0x7f54e40970a0 con 0x7f54e4096320 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e2ffd700 1 -- 172.21.15.31:0/1292685156 >> v1:172.21.15.31:6789/0 conn(0x7f54e4096320 legacy=0x7f54e405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e2ffd700 1 -- 172.21.15.31:0/1292685156 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4136a40 con 0x7f54e406c7d0 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e37fe700 1 --2- 172.21.15.31:0/1292685156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e405c080 0x7f54e4141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e2ffd700 1 --2- 172.21.15.31:0/1292685156 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e406c7d0 0x7f54e41360f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f54d8002f70 tx=0x7f54d8006eb0).ready entity=mon.2 client_cookie=6fe08f09401cae9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e1ffb700 1 -- 172.21.15.31:0/1292685156 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d800d5c0 con 0x7f54e406c7d0 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e1ffb700 1 -- 172.21.15.31:0/1292685156 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d8000e90 con 0x7f54e406c7d0 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e1ffb700 1 -- 172.21.15.31:0/1292685156 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d800d910 con 0x7f54e406c7d0 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e9668700 1 -- 172.21.15.31:0/1292685156 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e406c7d0 msgr2=0x7f54e41360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.837+0000 7f54e9668700 1 --2- 172.21.15.31:0/1292685156 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e406c7d0 0x7f54e41360f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f54d8002f70 tx=0x7f54d8006eb0).stop 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.838+0000 7f54e9668700 1 -- 172.21.15.31:0/1292685156 shutdown_connections 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.838+0000 7f54e9668700 1 --2- 172.21.15.31:0/1292685156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e405c080 0x7f54e4141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.838+0000 7f54e9668700 1 --2- 172.21.15.31:0/1292685156 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e406c7d0 0x7f54e41360f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.838+0000 7f54e9668700 1 -- 172.21.15.31:0/1292685156 >> 172.21.15.31:0/1292685156 conn(0x7f54e4061370 msgr2=0x7f54e406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:00.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.838+0000 7f54e9668700 1 -- 172.21.15.31:0/1292685156 shutdown_connections 2024-04-26T07:29:00.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.838+0000 7f54e9668700 1 -- 172.21.15.31:0/1292685156 wait complete. 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.838+0000 7f54e9668700 1 Processor -- start 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e9668700 1 -- start start 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e9668700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e405c080 0x7f54e4067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e9668700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54e406c7d0 0x7f54e409d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e9668700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e4096320 0x7f54e4065120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e9668700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e409ccd0 con 0x7f54e406c7d0 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e9668700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4146230 con 0x7f54e4096320 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e9668700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54e41464d0 con 0x7f54e405c080 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e2ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e405c080 0x7f54e4067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:00.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e4096320 0x7f54e4065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e2ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e405c080 0x7f54e4067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:56378/0 (socket says 172.21.15.31:56378) 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e2ffd700 1 -- 172.21.15.31:0/2090033314 learned_addr learned my addr 172.21.15.31:0/2090033314 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.839+0000 7f54e27fc700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54e406c7d0 0x7f54e409d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e37fe700 1 -- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e405c080 msgr2=0x7f54e4067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e37fe700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e405c080 0x7f54e4067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e37fe700 1 -- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54e406c7d0 msgr2=0x7f54e409d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e37fe700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54e406c7d0 0x7f54e409d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e37fe700 1 -- 172.21.15.31:0/2090033314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc009470 con 0x7f54e4096320 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e2ffd700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e405c080 0x7f54e4067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e37fe700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e4096320 0x7f54e4065120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f54dc00c000 tx=0x7f54dc0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54d3fff700 1 -- 172.21.15.31:0/2090033314 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54dc00c610 con 0x7f54e4096320 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54d3fff700 1 -- 172.21.15.31:0/2090033314 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00c770 con 0x7f54e4096320 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d800b1e0 con 0x7f54e4096320 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54d3fff700 1 -- 172.21.15.31:0/2090033314 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54dc00cad0 con 0x7f54e4096320 2024-04-26T07:29:00.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.840+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e4067d40 con 0x7f54e4096320 2024-04-26T07:29:00.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.841+0000 7f54d3fff700 1 -- 172.21.15.31:0/2090033314 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f54dc022070 con 0x7f54e4096320 2024-04-26T07:29:00.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.841+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e40975a0 con 0x7f54e4096320 2024-04-26T07:29:00.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.841+0000 7f54d3fff700 1 -- 172.21.15.31:0/2090033314 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f54dc04aed0 con 0x7f54e4096320 2024-04-26T07:29:00.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.844+0000 7f54d3fff700 1 -- 172.21.15.31:0/2090033314 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f54dc033800 con 0x7f54e4096320 2024-04-26T07:29:00.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.994+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54e4135750 con 0x7f54e4096320 2024-04-26T07:29:00.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.994+0000 7f54d3fff700 1 -- 172.21.15.31:0/2090033314 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f54dc0333f0 con 0x7f54e4096320 2024-04-26T07:29:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:00.994 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.995+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 >> v1:172.21.15.31:6816/39613 conn(0x7f54c0038da0 legacy=0x7f54c003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.995+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e4096320 msgr2=0x7f54e4065120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.995+0000 7f54e9668700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e4096320 0x7f54e4065120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f54dc00c000 tx=0x7f54dc0091d0).stop 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.995+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 shutdown_connections 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.995+0000 7f54e9668700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54e405c080 0x7f54e4067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.995+0000 7f54e9668700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54e4096320 0x7f54e4065120 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.995+0000 7f54e9668700 1 --2- 172.21.15.31:0/2090033314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54e406c7d0 0x7f54e409d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.995+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 >> 172.21.15.31:0/2090033314 conn(0x7f54e4061370 msgr2=0x7f54e40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.996+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 shutdown_connections 2024-04-26T07:29:00.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:00.996+0000 7f54e9668700 1 -- 172.21.15.31:0/2090033314 wait complete. 2024-04-26T07:29:00.997 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:01.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:01.309 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:02.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:02.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.431+0000 7fe7f7247700 1 Processor -- start 2024-04-26T07:29:02.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.431+0000 7fe7f7247700 1 -- start start 2024-04-26T07:29:02.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.431+0000 7fe7f7247700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f0137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:02.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.431+0000 7fe7f7247700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7f009ff30 0x7fe7f00a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:02.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.431+0000 7fe7f7247700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:02.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.431+0000 7fe7f7247700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f00a4e20 con 0x7fe7f009ff30 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.431+0000 7fe7f7247700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0137620 con 0x7fe7f0137a50 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.431+0000 7fe7f7247700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0138320 con 0x7fe7f00a3740 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7effff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7f009ff30 0x7fe7f00a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f4fe3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f0137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f57e4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7effff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7f009ff30 0x7fe7f00a3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54326/0 (socket says 172.21.15.31:54326) 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f4fe3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f0137e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47844/0 (socket says 172.21.15.31:47844) 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7effff700 1 -- 172.21.15.31:0/838128474 learned_addr learned my addr 172.21.15.31:0/838128474 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f57e4700 1 -- 172.21.15.31:0/838128474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 msgr2=0x7fe7f0137e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:02.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f57e4700 1 --2- 172.21.15.31:0/838128474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f0137e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f57e4700 1 -- 172.21.15.31:0/838128474 >> v2:172.21.15.31:3300/0 conn(0x7fe7f009ff30 msgr2=0x7fe7f00a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f57e4700 1 --2- 172.21.15.31:0/838128474 >> v2:172.21.15.31:3300/0 conn(0x7fe7f009ff30 0x7fe7f00a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f57e4700 1 -- 172.21.15.31:0/838128474 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f00a46a0 con 0x7fe7f00a3740 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7effff700 1 --2- 172.21.15.31:0/838128474 >> v2:172.21.15.31:3300/0 conn(0x7fe7f009ff30 0x7fe7f00a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7f57e4700 1 --2- 172.21.15.31:0/838128474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f005b970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe7e80032f0 tx=0x7fe7e80091d0).ready entity=mon.2 client_cookie=f7296d812506bb99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7ef7fe700 1 -- 172.21.15.31:0/838128474 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7e800b600 con 0x7fe7f00a3740 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7ef7fe700 1 -- 172.21.15.31:0/838128474 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800b760 con 0x7fe7f00a3740 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.432+0000 7fe7ef7fe700 1 -- 172.21.15.31:0/838128474 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7e800b8d0 con 0x7fe7f00a3740 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 -- 172.21.15.31:0/838128474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 msgr2=0x7fe7f005b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 --2- 172.21.15.31:0/838128474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f005b970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe7e80032f0 tx=0x7fe7e80091d0).stop 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 -- 172.21.15.31:0/838128474 shutdown_connections 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 --2- 172.21.15.31:0/838128474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f005b970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 --2- 172.21.15.31:0/838128474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f0137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 --2- 172.21.15.31:0/838128474 >> v2:172.21.15.31:3300/0 conn(0x7fe7f009ff30 0x7fe7f00a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 -- 172.21.15.31:0/838128474 >> 172.21.15.31:0/838128474 conn(0x7fe7f0060ee0 msgr2=0x7fe7f00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 -- 172.21.15.31:0/838128474 shutdown_connections 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.433+0000 7fe7f7247700 1 -- 172.21.15.31:0/838128474 wait complete. 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.434+0000 7fe7f7247700 1 Processor -- start 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.434+0000 7fe7f7247700 1 -- start start 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f7247700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f009ff30 0x7fe7f0061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f7247700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f00656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f7247700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f01334e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f7247700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00670e0 con 0x7fe7f009ff30 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f7247700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0066470 con 0x7fe7f0137a50 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f7247700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0066e20 con 0x7fe7f00a3740 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f4fe3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f009ff30 0x7fe7f0061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f57e4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f01334e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f4fe3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f009ff30 0x7fe7f0061a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54332/0 (socket says 172.21.15.31:54332) 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f4fe3700 1 -- 172.21.15.31:0/1797773736 learned_addr learned my addr 172.21.15.31:0/1797773736 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:02.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7effff700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f00656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7effff700 1 -- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 msgr2=0x7fe7f01334e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7effff700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f01334e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7effff700 1 -- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f009ff30 msgr2=0x7fe7f0061a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7effff700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f009ff30 0x7fe7f0061a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7effff700 1 -- 172.21.15.31:0/1797773736 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc00d660 con 0x7fe7f00a3740 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f4fe3700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f009ff30 0x7fe7f0061a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7effff700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f00656d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe7dc009000 tx=0x7fe7dc008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7edffb700 1 -- 172.21.15.31:0/1797773736 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7dc00d2c0 con 0x7fe7f00a3740 2024-04-26T07:29:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7edffb700 1 -- 172.21.15.31:0/1797773736 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc01f440 con 0x7fe7f00a3740 2024-04-26T07:29:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.435+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e8009470 con 0x7fe7f00a3740 2024-04-26T07:29:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.436+0000 7fe7edffb700 1 -- 172.21.15.31:0/1797773736 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7dc01f7a0 con 0x7fe7f00a3740 2024-04-26T07:29:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.436+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f0067530 con 0x7fe7f00a3740 2024-04-26T07:29:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.436+0000 7fe7edffb700 1 -- 172.21.15.31:0/1797773736 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe7dc01f900 con 0x7fe7f00a3740 2024-04-26T07:29:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.436+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f0061790 con 0x7fe7f00a3740 2024-04-26T07:29:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.437+0000 7fe7edffb700 1 -- 172.21.15.31:0/1797773736 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe7dc0536f0 con 0x7fe7f00a3740 2024-04-26T07:29:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.440+0000 7fe7edffb700 1 -- 172.21.15.31:0/1797773736 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe7f0061790 con 0x7fe7f00a3740 2024-04-26T07:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.592+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7f0061790 con 0x7fe7f00a3740 2024-04-26T07:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.592+0000 7fe7edffb700 1 -- 172.21.15.31:0/1797773736 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fe7f0061790 con 0x7fe7f00a3740 2024-04-26T07:29:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:02.593 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.593+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 >> v1:172.21.15.31:6816/39613 conn(0x7fe7d0038da0 legacy=0x7fe7d003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.593+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 msgr2=0x7fe7f00656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.593+0000 7fe7f7247700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f00656d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe7dc009000 tx=0x7fe7dc008040).stop 2024-04-26T07:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.593+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 shutdown_connections 2024-04-26T07:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.593+0000 7fe7f7247700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7f0137a50 0x7fe7f01334e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.593+0000 7fe7f7247700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f009ff30 0x7fe7f0061a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.593+0000 7fe7f7247700 1 --2- 172.21.15.31:0/1797773736 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe7f00a3740 0x7fe7f00656d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:02.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.593+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 >> 172.21.15.31:0/1797773736 conn(0x7fe7f0060ee0 msgr2=0x7fe7f005c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:02.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.594+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 shutdown_connections 2024-04-26T07:29:02.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:02.594+0000 7fe7f7247700 1 -- 172.21.15.31:0/1797773736 wait complete. 2024-04-26T07:29:02.596 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:02.907 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:02.907 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:03.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:04.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.029+0000 7fb2b08f7700 1 Processor -- start 2024-04-26T07:29:04.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.029+0000 7fb2b08f7700 1 -- start start 2024-04-26T07:29:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2b08f7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac09e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2b08f7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2ac09f420 0x7fb2ac0a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2b08f7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac09e2a0 con 0x7fb2ac09c9e0 2024-04-26T07:29:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2b08f7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ac09ce70 con 0x7fb2ac09f420 2024-04-26T07:29:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2b08f7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac09d110 con 0x7fb2ac0a3170 2024-04-26T07:29:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2aad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2ac09f420 0x7fb2ac0a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2aa59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac09e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2a9d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb2ac09c9e0 0x7fb2ac0a3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59328/0 (socket says 172.21.15.31:59328) 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2aad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2ac09f420 0x7fb2ac0a3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54344/0 (socket says 172.21.15.31:54344) 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.030+0000 7fb2a9d9b700 1 -- 172.21.15.31:0/154353136 learned_addr learned my addr 172.21.15.31:0/154353136 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2aad9d700 1 -- 172.21.15.31:0/154353136 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 msgr2=0x7fb2ac09e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2aad9d700 1 --2- 172.21.15.31:0/154353136 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac09e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2aad9d700 1 -- 172.21.15.31:0/154353136 >> v1:172.21.15.31:6789/0 conn(0x7fb2ac09c9e0 legacy=0x7fb2ac0a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2aad9d700 1 -- 172.21.15.31:0/154353136 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac05c4e0 con 0x7fb2ac09f420 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2a959a700 1 -- 172.21.15.31:0/154353136 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543228764 0 0) 0x7fb2ac09e2a0 con 0x7fb2ac09c9e0 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2aad9d700 1 --2- 172.21.15.31:0/154353136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac09f420 0x7fb2ac0a3c60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb2a40032f0 tx=0x7fb2a40091d0).ready entity=mon.0 client_cookie=66cdda378e2d2c3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2a959a700 1 -- 172.21.15.31:0/154353136 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a400b6c0 con 0x7fb2ac09f420 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2a959a700 1 -- 172.21.15.31:0/154353136 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a400b820 con 0x7fb2ac09f420 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.031+0000 7fb2a959a700 1 -- 172.21.15.31:0/154353136 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a400b990 con 0x7fb2ac09f420 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.032+0000 7fb2b08f7700 1 -- 172.21.15.31:0/154353136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac09f420 msgr2=0x7fb2ac0a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.032+0000 7fb2b08f7700 1 --2- 172.21.15.31:0/154353136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac09f420 0x7fb2ac0a3c60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb2a40032f0 tx=0x7fb2a40091d0).stop 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.032+0000 7fb2b08f7700 1 -- 172.21.15.31:0/154353136 shutdown_connections 2024-04-26T07:29:04.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.032+0000 7fb2b08f7700 1 --2- 172.21.15.31:0/154353136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac09f420 0x7fb2ac0a3c60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:04.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.032+0000 7fb2b08f7700 1 --2- 172.21.15.31:0/154353136 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac09e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:04.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.032+0000 7fb2b08f7700 1 -- 172.21.15.31:0/154353136 >> 172.21.15.31:0/154353136 conn(0x7fb2ac060ee0 msgr2=0x7fb2ac0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:04.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.032+0000 7fb2b08f7700 1 -- 172.21.15.31:0/154353136 shutdown_connections 2024-04-26T07:29:04.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.032+0000 7fb2b08f7700 1 -- 172.21.15.31:0/154353136 wait complete. 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.033+0000 7fb2b08f7700 1 Processor -- start 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.033+0000 7fb2b08f7700 1 -- start start 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2b08f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2ac09f420 0x7fb2ac13b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2b08f7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2b08f7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac139c40 0x7fb2ac13a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2b08f7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac13a5e0 con 0x7fb2ac139c40 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2b08f7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0621d0 con 0x7fb2ac09f420 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2b08f7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac061a70 con 0x7fb2ac0a3170 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2aa59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2ac09f420 0x7fb2ac13b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:04.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac139750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:56412/0 (socket says 172.21.15.31:56412) 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 -- 172.21.15.31:0/555437812 learned_addr learned my addr 172.21.15.31:0/555437812 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2aad9d700 1 --2- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac139c40 0x7fb2ac13a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 -- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2ac09f420 msgr2=0x7fb2ac13b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 --2- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2ac09f420 0x7fb2ac13b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 -- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac139c40 msgr2=0x7fb2ac13a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 --2- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac139c40 0x7fb2ac13a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 -- 172.21.15.31:0/555437812 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4009470 con 0x7fb2ac0a3170 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a9d9b700 1 --2- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac139750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb2ac13a720 tx=0x7fb294007a00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a37fe700 1 -- 172.21.15.31:0/555437812 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2940070d0 con 0x7fb2ac0a3170 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a37fe700 1 -- 172.21.15.31:0/555437812 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294007230 con 0x7fb2ac0a3170 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ac13bdb0 con 0x7fb2ac0a3170 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2a37fe700 1 -- 172.21.15.31:0/555437812 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb294005610 con 0x7fb2ac0a3170 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.034+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac13c320 con 0x7fb2ac0a3170 2024-04-26T07:29:04.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.035+0000 7fb2a37fe700 1 -- 172.21.15.31:0/555437812 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb29401a060 con 0x7fb2ac0a3170 2024-04-26T07:29:04.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.036+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ac0626f0 con 0x7fb2ac0a3170 2024-04-26T07:29:04.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.036+0000 7fb2a37fe700 1 -- 172.21.15.31:0/555437812 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb294049f40 con 0x7fb2ac0a3170 2024-04-26T07:29:04.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.039+0000 7fb2a37fe700 1 -- 172.21.15.31:0/555437812 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb2ac0626f0 con 0x7fb2ac0a3170 2024-04-26T07:29:04.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.191+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2ac062380 con 0x7fb2ac0a3170 2024-04-26T07:29:04.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.191+0000 7fb2a37fe700 1 -- 172.21.15.31:0/555437812 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fb2ac062380 con 0x7fb2ac0a3170 2024-04-26T07:29:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:04.192 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:04.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 >> v1:172.21.15.31:6816/39613 conn(0x7fb290038da0 legacy=0x7fb29003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:04.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 msgr2=0x7fb2ac139750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:04.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 --2- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac139750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb2ac13a720 tx=0x7fb294007a00).stop 2024-04-26T07:29:04.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 shutdown_connections 2024-04-26T07:29:04.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 --2- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2ac139c40 0x7fb2ac13a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:04.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 --2- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2ac09f420 0x7fb2ac13b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:04.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 --2- 172.21.15.31:0/555437812 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2ac0a3170 0x7fb2ac139750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:04.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 >> 172.21.15.31:0/555437812 conn(0x7fb2ac060ee0 msgr2=0x7fb2ac09e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:04.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 shutdown_connections 2024-04-26T07:29:04.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:04.193+0000 7fb2b08f7700 1 -- 172.21.15.31:0/555437812 wait complete. 2024-04-26T07:29:04.194 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:04.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:04.506 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:05.507 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.627+0000 7f1493a08700 1 Processor -- start 2024-04-26T07:29:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.627+0000 7f1493a08700 1 -- start start 2024-04-26T07:29:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1493a08700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f148c06c7d0 0x7f148c1360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1493a08700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c096320 0x7f148c05b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1493a08700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c05c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1493a08700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c133c10 con 0x7f148c06c7d0 2024-04-26T07:29:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1493a08700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c05c7e0 con 0x7f148c096320 2024-04-26T07:29:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1493a08700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0970a0 con 0x7f148c05be60 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1491fa5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c05c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1490fa3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c096320 0x7f148c05b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1490fa3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c096320 0x7f148c05b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47878/0 (socket says 172.21.15.31:47878) 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1491fa5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c05c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:56422/0 (socket says 172.21.15.31:56422) 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1490fa3700 1 -- 172.21.15.31:0/3019052092 learned_addr learned my addr 172.21.15.31:0/3019052092 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f14917a4700 1 --2- 172.21.15.31:0/3019052092 >> v2:172.21.15.31:3300/0 conn(0x7f148c06c7d0 0x7f148c1360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1491fa5700 1 -- 172.21.15.31:0/3019052092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c096320 msgr2=0x7f148c05b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1491fa5700 1 --2- 172.21.15.31:0/3019052092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c096320 0x7f148c05b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1491fa5700 1 -- 172.21.15.31:0/3019052092 >> v2:172.21.15.31:3300/0 conn(0x7f148c06c7d0 msgr2=0x7f148c1360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1491fa5700 1 --2- 172.21.15.31:0/3019052092 >> v2:172.21.15.31:3300/0 conn(0x7f148c06c7d0 0x7f148c1360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1491fa5700 1 -- 172.21.15.31:0/3019052092 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c136780 con 0x7f148c05be60 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1490fa3700 1 --2- 172.21.15.31:0/3019052092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c096320 0x7f148c05b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.628+0000 7f1491fa5700 1 --2- 172.21.15.31:0/3019052092 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c05c2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f14840032f0 tx=0x7f14840091d0).ready entity=mon.2 client_cookie=ad76099a8b0b9547 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f147bfff700 1 -- 172.21.15.31:0/3019052092 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148400b5a0 con 0x7f148c05be60 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f147bfff700 1 -- 172.21.15.31:0/3019052092 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148400b700 con 0x7f148c05be60 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f147bfff700 1 -- 172.21.15.31:0/3019052092 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148400b870 con 0x7f148c05be60 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 -- 172.21.15.31:0/3019052092 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 msgr2=0x7f148c05c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 --2- 172.21.15.31:0/3019052092 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c05c2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f14840032f0 tx=0x7f14840091d0).stop 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 -- 172.21.15.31:0/3019052092 shutdown_connections 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 --2- 172.21.15.31:0/3019052092 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c05c2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 --2- 172.21.15.31:0/3019052092 >> v2:172.21.15.31:3300/0 conn(0x7f148c06c7d0 0x7f148c1360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 --2- 172.21.15.31:0/3019052092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c096320 0x7f148c05b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 -- 172.21.15.31:0/3019052092 >> 172.21.15.31:0/3019052092 conn(0x7f148c061370 msgr2=0x7f148c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 -- 172.21.15.31:0/3019052092 shutdown_connections 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.629+0000 7f1493a08700 1 -- 172.21.15.31:0/3019052092 wait complete. 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.630+0000 7f1493a08700 1 Processor -- start 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.630+0000 7f1493a08700 1 -- start start 2024-04-26T07:29:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1493a08700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1493a08700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c06c7d0 0x7f148c066f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1493a08700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c096320 0x7f148c067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1493a08700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c09df70 con 0x7f148c096320 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1493a08700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c14a010 con 0x7f148c06c7d0 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1493a08700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148c066cb0 con 0x7f148c05be60 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1490fa3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c06c7d0 0x7f148c066f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:56436/0 (socket says 172.21.15.31:56436) 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1491fa5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c096320 0x7f148c067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 -- 172.21.15.31:0/1431859615 learned_addr learned my addr 172.21.15.31:0/1431859615 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1490fa3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c06c7d0 0x7f148c066f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47894/0 (socket says 172.21.15.31:47894) 2024-04-26T07:29:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 -- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c06c7d0 msgr2=0x7f148c066f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c06c7d0 0x7f148c066f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 -- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c096320 msgr2=0x7f148c067460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c096320 0x7f148c067460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 -- 172.21.15.31:0/1431859615 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148800b1e0 con 0x7f148c05be60 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1491fa5700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c096320 0x7f148c067460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f1490fa3700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c06c7d0 0x7f148c066f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.631+0000 7f14917a4700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c149b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f147c00c000 tx=0x7f147c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.632+0000 7f147a7fc700 1 -- 172.21.15.31:0/1431859615 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147c010780 con 0x7f148c05be60 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.632+0000 7f147a7fc700 1 -- 172.21.15.31:0/1431859615 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c0108e0 con 0x7f148c05be60 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.632+0000 7f147a7fc700 1 -- 172.21.15.31:0/1431859615 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147c010c40 con 0x7f148c05be60 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.632+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1484009470 con 0x7f148c05be60 2024-04-26T07:29:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.632+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1496b0 con 0x7f148c05be60 2024-04-26T07:29:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.632+0000 7f147a7fc700 1 -- 172.21.15.31:0/1431859615 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f147c01c460 con 0x7f148c05be60 2024-04-26T07:29:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.633+0000 7f147a7fc700 1 -- 172.21.15.31:0/1431859615 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f147c04acc0 con 0x7f148c05be60 2024-04-26T07:29:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.633+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c09cdb0 con 0x7f148c05be60 2024-04-26T07:29:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.636+0000 7f147a7fc700 1 -- 172.21.15.31:0/1431859615 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f147c033550 con 0x7f148c05be60 2024-04-26T07:29:05.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.787+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f148c136a40 con 0x7f148c05be60 2024-04-26T07:29:05.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.787+0000 7f147a7fc700 1 -- 172.21.15.31:0/1431859615 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f147c02a090 con 0x7f148c05be60 2024-04-26T07:29:05.788 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:05.788 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 >> v1:172.21.15.31:6816/39613 conn(0x7f146c038da0 legacy=0x7f146c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 msgr2=0x7f148c149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c149b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f147c00c000 tx=0x7f147c006df0).stop 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 shutdown_connections 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f148c05be60 0x7f148c149b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148c096320 0x7f148c067460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 --2- 172.21.15.31:0/1431859615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f148c06c7d0 0x7f148c066f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 >> 172.21.15.31:0/1431859615 conn(0x7f148c061370 msgr2=0x7f148c0989a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 shutdown_connections 2024-04-26T07:29:05.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:05.789+0000 7f1493a08700 1 -- 172.21.15.31:0/1431859615 wait complete. 2024-04-26T07:29:05.790 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:06.102 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:06.102 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:07.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:07.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.223+0000 7efc19637700 1 Processor -- start 2024-04-26T07:29:07.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.223+0000 7efc19637700 1 -- start start 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc19637700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc19637700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14134840 0x7efc140635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc19637700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc14063aa0 0x7efc1409a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc19637700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc14065770 con 0x7efc14063aa0 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc19637700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1409c5e0 con 0x7efc14134840 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc19637700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc14134240 con 0x7efc14134460 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc137fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc14063aa0 0x7efc1409a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc127fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14134840 0x7efc140635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc12ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc137fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc14063aa0 0x7efc1409a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54374/0 (socket says 172.21.15.31:54374) 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc12ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14065280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:56452/0 (socket says 172.21.15.31:56452) 2024-04-26T07:29:07.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc127fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14134840 0x7efc140635b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47906/0 (socket says 172.21.15.31:47906) 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.224+0000 7efc137fe700 1 -- 172.21.15.31:0/1272049800 learned_addr learned my addr 172.21.15.31:0/1272049800 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc127fc700 1 -- 172.21.15.31:0/1272049800 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 msgr2=0x7efc14065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc127fc700 1 --2- 172.21.15.31:0/1272049800 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc127fc700 1 -- 172.21.15.31:0/1272049800 >> v2:172.21.15.31:3300/0 conn(0x7efc14063aa0 msgr2=0x7efc1409a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc127fc700 1 --2- 172.21.15.31:0/1272049800 >> v2:172.21.15.31:3300/0 conn(0x7efc14063aa0 0x7efc1409a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc127fc700 1 -- 172.21.15.31:0/1272049800 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1409bb10 con 0x7efc14134840 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc137fe700 1 --2- 172.21.15.31:0/1272049800 >> v2:172.21.15.31:3300/0 conn(0x7efc14063aa0 0x7efc1409a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc12ffd700 1 --2- 172.21.15.31:0/1272049800 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc127fc700 1 --2- 172.21.15.31:0/1272049800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14134840 0x7efc140635b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efc04002f70 tx=0x7efc04006e80).ready entity=mon.1 client_cookie=1c560b4938a63e77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:07.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc11ffb700 1 -- 172.21.15.31:0/1272049800 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc04012070 con 0x7efc14134840 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc11ffb700 1 -- 172.21.15.31:0/1272049800 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc04000e90 con 0x7efc14134840 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.225+0000 7efc11ffb700 1 -- 172.21.15.31:0/1272049800 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc04017850 con 0x7efc14134840 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 -- 172.21.15.31:0/1272049800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14134840 msgr2=0x7efc140635b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 --2- 172.21.15.31:0/1272049800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14134840 0x7efc140635b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efc04002f70 tx=0x7efc04006e80).stop 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 -- 172.21.15.31:0/1272049800 shutdown_connections 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 --2- 172.21.15.31:0/1272049800 >> v2:172.21.15.31:3300/0 conn(0x7efc14063aa0 0x7efc1409a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 --2- 172.21.15.31:0/1272049800 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 --2- 172.21.15.31:0/1272049800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14134840 0x7efc140635b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 -- 172.21.15.31:0/1272049800 >> 172.21.15.31:0/1272049800 conn(0x7efc1405cfb0 msgr2=0x7efc14062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 -- 172.21.15.31:0/1272049800 shutdown_connections 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.226+0000 7efc19637700 1 -- 172.21.15.31:0/1272049800 wait complete. 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc19637700 1 Processor -- start 2024-04-26T07:29:07.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc19637700 1 -- start start 2024-04-26T07:29:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc19637700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14063aa0 0x7efc14091f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc19637700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc19637700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc14134840 0x7efc14144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc19637700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc141352d0 con 0x7efc14134840 2024-04-26T07:29:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc19637700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc14092d20 con 0x7efc14063aa0 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc19637700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc141375a0 con 0x7efc14134460 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc12ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14063aa0 0x7efc14091f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc127fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc127fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:56460/0 (socket says 172.21.15.31:56460) 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc127fc700 1 -- 172.21.15.31:0/2478751026 learned_addr learned my addr 172.21.15.31:0/2478751026 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc12ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14063aa0 0x7efc14091f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47922/0 (socket says 172.21.15.31:47922) 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.227+0000 7efc137fe700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc14134840 0x7efc14144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc127fc700 1 -- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14063aa0 msgr2=0x7efc14091f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc127fc700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14063aa0 0x7efc14091f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc127fc700 1 -- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc14134840 msgr2=0x7efc14144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc127fc700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc14134840 0x7efc14144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc127fc700 1 -- 172.21.15.31:0/2478751026 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009530 con 0x7efc14134460 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc12ffd700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14063aa0 0x7efc14091f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc137fe700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc14134840 0x7efc14144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:07.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc127fc700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14144a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7efc04002f70 tx=0x7efc04006e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc03fff700 1 -- 172.21.15.31:0/2478751026 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0400b850 con 0x7efc14134460 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc03fff700 1 -- 172.21.15.31:0/2478751026 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0400b9b0 con 0x7efc14134460 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0800b180 con 0x7efc14134460 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc03fff700 1 -- 172.21.15.31:0/2478751026 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0400bd10 con 0x7efc14134460 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.228+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0400d590 con 0x7efc14134460 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.229+0000 7efc03fff700 1 -- 172.21.15.31:0/2478751026 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7efc0402b070 con 0x7efc14134460 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.229+0000 7efc03fff700 1 -- 172.21.15.31:0/2478751026 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efc0404f6e0 con 0x7efc14134460 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.229+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc14133f10 con 0x7efc14134460 2024-04-26T07:29:07.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.232+0000 7efc03fff700 1 -- 172.21.15.31:0/2478751026 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7efc040249d0 con 0x7efc14134460 2024-04-26T07:29:07.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.381+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc14062b20 con 0x7efc14134460 2024-04-26T07:29:07.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.382+0000 7efc03fff700 1 -- 172.21.15.31:0/2478751026 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7efc04024800 con 0x7efc14134460 2024-04-26T07:29:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:07.382 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:07.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 >> v1:172.21.15.31:6816/39613 conn(0x7efbf0038da0 legacy=0x7efbf003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:07.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 msgr2=0x7efc14144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:07.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14144a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7efc04002f70 tx=0x7efc04006e80).stop 2024-04-26T07:29:07.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 shutdown_connections 2024-04-26T07:29:07.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc14134840 0x7efc14144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc14063aa0 0x7efc14091f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 --2- 172.21.15.31:0/2478751026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc14134460 0x7efc14144a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:07.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 >> 172.21.15.31:0/2478751026 conn(0x7efc1405cfb0 msgr2=0x7efc1406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:07.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 shutdown_connections 2024-04-26T07:29:07.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:07.383+0000 7efc19637700 1 -- 172.21.15.31:0/2478751026 wait complete. 2024-04-26T07:29:07.384 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:07.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:07.697 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:08.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.818+0000 7fbf0daf1700 1 Processor -- start 2024-04-26T07:29:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.818+0000 7fbf0daf1700 1 -- start start 2024-04-26T07:29:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf0daf1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf0806c7d0 0x7fbf081360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf0daf1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf08096320 0x7fbf0805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf0daf1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf080970a0 con 0x7fbf0805be60 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf0daf1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08133c10 con 0x7fbf08096320 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf0daf1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08136780 con 0x7fbf0806c7d0 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf077fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf0806c7d0 0x7fbf081360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf06ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf08096320 0x7fbf0805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf07fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbf0805be60 0x7fbf08140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53320/0 (socket says 172.21.15.31:53320) 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf07fff700 1 -- 172.21.15.31:0/4053042271 learned_addr learned my addr 172.21.15.31:0/4053042271 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf06ffd700 1 -- 172.21.15.31:0/4053042271 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf0806c7d0 msgr2=0x7fbf081360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf06ffd700 1 --2- 172.21.15.31:0/4053042271 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf0806c7d0 0x7fbf081360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf06ffd700 1 -- 172.21.15.31:0/4053042271 >> v1:172.21.15.31:6789/0 conn(0x7fbf0805be60 legacy=0x7fbf08140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf067fc700 1 -- 172.21.15.31:0/4053042271 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724090551 0 0) 0x7fbf080970a0 con 0x7fbf0805be60 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf06ffd700 1 -- 172.21.15.31:0/4053042271 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf08136a40 con 0x7fbf08096320 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf077fe700 1 --2- 172.21.15.31:0/4053042271 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf0806c7d0 0x7fbf081360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.819+0000 7fbf06ffd700 1 --2- 172.21.15.31:0/4053042271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf08096320 0x7fbf0805b970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fbef0002f70 tx=0x7fbef0006df0).ready entity=mon.1 client_cookie=e6c5af765df1d8f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:08.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf067fc700 1 -- 172.21.15.31:0/4053042271 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef000d570 con 0x7fbf08096320 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf067fc700 1 -- 172.21.15.31:0/4053042271 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0000e90 con 0x7fbf08096320 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf067fc700 1 -- 172.21.15.31:0/4053042271 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef000d8c0 con 0x7fbf08096320 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4053042271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf08096320 msgr2=0x7fbf0805b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf0daf1700 1 --2- 172.21.15.31:0/4053042271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf08096320 0x7fbf0805b970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fbef0002f70 tx=0x7fbef0006df0).stop 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4053042271 shutdown_connections 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf0daf1700 1 --2- 172.21.15.31:0/4053042271 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf0806c7d0 0x7fbf081360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf0daf1700 1 --2- 172.21.15.31:0/4053042271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf08096320 0x7fbf0805b970 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4053042271 >> 172.21.15.31:0/4053042271 conn(0x7fbf08061370 msgr2=0x7fbf0806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4053042271 shutdown_connections 2024-04-26T07:29:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.820+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4053042271 wait complete. 2024-04-26T07:29:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.821+0000 7fbf0daf1700 1 Processor -- start 2024-04-26T07:29:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.821+0000 7fbf0daf1700 1 -- start start 2024-04-26T07:29:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf0daf1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0805be60 0x7fbf08149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf0daf1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0806c7d0 0x7fbf080622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf0daf1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf08096320 0x7fbf080627d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf0daf1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0814a050 con 0x7fbf0806c7d0 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf0daf1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08149190 con 0x7fbf0805be60 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf0daf1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf080620a0 con 0x7fbf08096320 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0805be60 0x7fbf08149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0805be60 0x7fbf08149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44532/0 (socket says 172.21.15.31:44532) 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 -- 172.21.15.31:0/4255840810 learned_addr learned my addr 172.21.15.31:0/4255840810 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf07fff700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf08096320 0x7fbf080627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf06ffd700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0806c7d0 0x7fbf080622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 -- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf08096320 msgr2=0x7fbf080627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf08096320 0x7fbf080627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 -- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0806c7d0 msgr2=0x7fbf080622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0806c7d0 0x7fbf080622e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 -- 172.21.15.31:0/4255840810 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef800b180 con 0x7fbf0805be60 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf06ffd700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0806c7d0 0x7fbf080622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.822+0000 7fbf077fe700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0805be60 0x7fbf08149650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fbf0814a190 tx=0x7fbef8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.823+0000 7fbf04ff9700 1 -- 172.21.15.31:0/4255840810 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef800c890 con 0x7fbf0805be60 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.823+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef000b180 con 0x7fbf0805be60 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.823+0000 7fbf04ff9700 1 -- 172.21.15.31:0/4255840810 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef800c9f0 con 0x7fbf0805be60 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.823+0000 7fbf04ff9700 1 -- 172.21.15.31:0/4255840810 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef800cd50 con 0x7fbf0805be60 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.823+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf08149b40 con 0x7fbf0805be60 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.824+0000 7fbf04ff9700 1 -- 172.21.15.31:0/4255840810 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbef801c460 con 0x7fbf0805be60 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.824+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf080975a0 con 0x7fbf0805be60 2024-04-26T07:29:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.824+0000 7fbf04ff9700 1 -- 172.21.15.31:0/4255840810 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbef804af40 con 0x7fbf0805be60 2024-04-26T07:29:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.827+0000 7fbf04ff9700 1 -- 172.21.15.31:0/4255840810 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbef80301a0 con 0x7fbf0805be60 2024-04-26T07:29:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.975+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf08097d50 con 0x7fbf0805be60 2024-04-26T07:29:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.976+0000 7fbf04ff9700 1 -- 172.21.15.31:0/4255840810 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fbef80333c0 con 0x7fbf0805be60 2024-04-26T07:29:08.976 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:08.976 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:08.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 >> v1:172.21.15.31:6816/39613 conn(0x7fbeec038da0 legacy=0x7fbeec03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:08.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0805be60 msgr2=0x7fbf08149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:08.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0805be60 0x7fbf08149650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fbf0814a190 tx=0x7fbef8006df0).stop 2024-04-26T07:29:08.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 shutdown_connections 2024-04-26T07:29:08.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbf08096320 0x7fbf080627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:08.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0805be60 0x7fbf08149650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:08.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 --2- 172.21.15.31:0/4255840810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0806c7d0 0x7fbf080622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:08.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 >> 172.21.15.31:0/4255840810 conn(0x7fbf08061370 msgr2=0x7fbf080a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:08.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 shutdown_connections 2024-04-26T07:29:08.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:08.977+0000 7fbf0daf1700 1 -- 172.21.15.31:0/4255840810 wait complete. 2024-04-26T07:29:08.978 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:09.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:09.290 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:10.291 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.411+0000 7fb1aac61700 1 Processor -- start 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.411+0000 7fb1aac61700 1 -- start start 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1aac61700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1a40a95d0 0x7fb1a413e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1aac61700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1aac61700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a4139600 con 0x7fb1a4099b80 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1aac61700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a4099810 con 0x7fb1a40a95d0 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1aac61700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4099f60 con 0x7fb1a409ba30 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1a40a95d0 0x7fb1a413e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a91fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a89fd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb1a4099b80 0x7fb1a409ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53332/0 (socket says 172.21.15.31:53332) 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a89fd700 1 -- 172.21.15.31:0/1017528289 learned_addr learned my addr 172.21.15.31:0/1017528289 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a91fe700 1 -- 172.21.15.31:0/1017528289 >> v2:172.21.15.31:3300/0 conn(0x7fb1a40a95d0 msgr2=0x7fb1a413e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a91fe700 1 --2- 172.21.15.31:0/1017528289 >> v2:172.21.15.31:3300/0 conn(0x7fb1a40a95d0 0x7fb1a413e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a91fe700 1 -- 172.21.15.31:0/1017528289 >> v1:172.21.15.31:6789/0 conn(0x7fb1a4099b80 legacy=0x7fb1a409ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a91fe700 1 -- 172.21.15.31:0/1017528289 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a409a0d0 con 0x7fb1a409ba30 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.412+0000 7fb1a3fff700 1 --2- 172.21.15.31:0/1017528289 >> v2:172.21.15.31:3300/0 conn(0x7fb1a40a95d0 0x7fb1a413e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1a91fe700 1 --2- 172.21.15.31:0/1017528289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4140cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb19c0032f0 tx=0x7fb19c0091d0).ready entity=mon.1 client_cookie=de7968cf6fbdef2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1a37fe700 1 -- 172.21.15.31:0/1017528289 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c00b6c0 con 0x7fb1a409ba30 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1a37fe700 1 -- 172.21.15.31:0/1017528289 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c00b820 con 0x7fb1a409ba30 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1a37fe700 1 -- 172.21.15.31:0/1017528289 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c00b990 con 0x7fb1a409ba30 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1aac61700 1 -- 172.21.15.31:0/1017528289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 msgr2=0x7fb1a4140cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1aac61700 1 --2- 172.21.15.31:0/1017528289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4140cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb19c0032f0 tx=0x7fb19c0091d0).stop 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1aac61700 1 -- 172.21.15.31:0/1017528289 shutdown_connections 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1aac61700 1 --2- 172.21.15.31:0/1017528289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4140cd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1aac61700 1 --2- 172.21.15.31:0/1017528289 >> v2:172.21.15.31:3300/0 conn(0x7fb1a40a95d0 0x7fb1a413e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:10.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1aac61700 1 -- 172.21.15.31:0/1017528289 >> 172.21.15.31:0/1017528289 conn(0x7fb1a405cc10 msgr2=0x7fb1a405d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1aac61700 1 -- 172.21.15.31:0/1017528289 shutdown_connections 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.413+0000 7fb1aac61700 1 -- 172.21.15.31:0/1017528289 wait complete. 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.414+0000 7fb1aac61700 1 Processor -- start 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.414+0000 7fb1aac61700 1 -- start start 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1aac61700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb1a4099b80 0x7fb1a40934e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1aac61700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1aac61700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a40a95d0 0x7fb1a4149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1aac61700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40958a0 con 0x7fb1a40a95d0 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1aac61700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4095a30 con 0x7fb1a409ba30 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1aac61700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4093ba0 con 0x7fb1a4099b80 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1a3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1a91fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a40a95d0 0x7fb1a4149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1a3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4148d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44542/0 (socket says 172.21.15.31:44542) 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1a3fff700 1 -- 172.21.15.31:0/1837011519 learned_addr learned my addr 172.21.15.31:0/1837011519 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:10.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.415+0000 7fb1a89fd700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb1a4099b80 0x7fb1a40934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a91fe700 1 -- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb1a4099b80 msgr2=0x7fb1a40934e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a91fe700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb1a4099b80 0x7fb1a40934e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a91fe700 1 -- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 msgr2=0x7fb1a4148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a91fe700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a91fe700 1 -- 172.21.15.31:0/1837011519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19000b180 con 0x7fb1a40a95d0 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a3fff700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a91fe700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a40a95d0 0x7fb1a4149230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb19c0032f0 tx=0x7fb19c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a1ffb700 1 -- 172.21.15.31:0/1837011519 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c011d50 con 0x7fb1a40a95d0 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a1ffb700 1 -- 172.21.15.31:0/1837011519 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c021440 con 0x7fb1a40a95d0 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c009470 con 0x7fb1a40a95d0 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1a1ffb700 1 -- 172.21.15.31:0/1837011519 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb19c0217a0 con 0x7fb1a40a95d0 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.416+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a4135590 con 0x7fb1a40a95d0 2024-04-26T07:29:10.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.417+0000 7fb1a1ffb700 1 -- 172.21.15.31:0/1837011519 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb19c027020 con 0x7fb1a40a95d0 2024-04-26T07:29:10.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.417+0000 7fb1a1ffb700 1 -- 172.21.15.31:0/1837011519 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb19c04bb90 con 0x7fb1a40a95d0 2024-04-26T07:29:10.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.417+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a4095ba0 con 0x7fb1a40a95d0 2024-04-26T07:29:10.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.420+0000 7fb1a1ffb700 1 -- 172.21.15.31:0/1837011519 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb1a4095ba0 con 0x7fb1a40a95d0 2024-04-26T07:29:10.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.567+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1a4095ba0 con 0x7fb1a40a95d0 2024-04-26T07:29:10.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.568+0000 7fb1a1ffb700 1 -- 172.21.15.31:0/1837011519 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fb1a4095ba0 con 0x7fb1a40a95d0 2024-04-26T07:29:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:10.568 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 >> v1:172.21.15.31:6816/39613 conn(0x7fb184038ec0 legacy=0x7fb18403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a40a95d0 msgr2=0x7fb1a4149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a40a95d0 0x7fb1a4149230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb19c0032f0 tx=0x7fb19c016000).stop 2024-04-26T07:29:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 shutdown_connections 2024-04-26T07:29:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb1a4099b80 0x7fb1a40934e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a40a95d0 0x7fb1a4149230 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 --2- 172.21.15.31:0/1837011519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1a409ba30 0x7fb1a4148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 >> 172.21.15.31:0/1837011519 conn(0x7fb1a405cc10 msgr2=0x7fb1a40664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 shutdown_connections 2024-04-26T07:29:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:10.569+0000 7fb1aac61700 1 -- 172.21.15.31:0/1837011519 wait complete. 2024-04-26T07:29:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:10.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:10.882 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:11.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:12.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.003+0000 7f9e09217700 1 Processor -- start 2024-04-26T07:29:12.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.003+0000 7f9e09217700 1 -- start start 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e09217700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e0405dfb0 0x7f9e041330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e09217700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04133590 0x7f9e04133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e09217700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e04133f10 con 0x7f9e04067d70 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e09217700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e04067580 con 0x7f9e0405dfb0 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e09217700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04066600 con 0x7f9e04133590 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e0405dfb0 0x7f9e041330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0359e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04133590 0x7f9e04133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e02d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9e04067d70 0x7f9e04066e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53338/0 (socket says 172.21.15.31:53338) 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e02d9d700 1 -- 172.21.15.31:0/4253147001 learned_addr learned my addr 172.21.15.31:0/4253147001 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0259c700 1 --2- 172.21.15.31:0/4253147001 >> v2:172.21.15.31:3300/0 conn(0x7f9e0405dfb0 0x7f9e041330a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39798/0 (socket says 172.21.15.31:39798) 2024-04-26T07:29:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0259c700 1 -- 172.21.15.31:0/4253147001 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04133590 msgr2=0x7f9e04133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0259c700 1 --2- 172.21.15.31:0/4253147001 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04133590 0x7f9e04133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0259c700 1 -- 172.21.15.31:0/4253147001 >> v1:172.21.15.31:6789/0 conn(0x7f9e04067d70 legacy=0x7f9e04066e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e01d9b700 1 -- 172.21.15.31:0/4253147001 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342459509 0 0) 0x7f9df4001110 con 0x7f9e04067d70 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0259c700 1 -- 172.21.15.31:0/4253147001 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040a4730 con 0x7f9e0405dfb0 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0359e700 1 --2- 172.21.15.31:0/4253147001 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04133590 0x7f9e04133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e0259c700 1 --2- 172.21.15.31:0/4253147001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0405dfb0 0x7f9e041330a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9df8002f70 tx=0x7f9df8006df0).ready entity=mon.0 client_cookie=aa8ffe837cdf98a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e01d9b700 1 -- 172.21.15.31:0/4253147001 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df800d570 con 0x7f9e0405dfb0 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.004+0000 7f9e01d9b700 1 -- 172.21.15.31:0/4253147001 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df8000e90 con 0x7f9e0405dfb0 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e01d9b700 1 -- 172.21.15.31:0/4253147001 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df800d8c0 con 0x7f9e0405dfb0 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e09217700 1 -- 172.21.15.31:0/4253147001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0405dfb0 msgr2=0x7f9e041330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e09217700 1 --2- 172.21.15.31:0/4253147001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0405dfb0 0x7f9e041330a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9df8002f70 tx=0x7f9df8006df0).stop 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e09217700 1 -- 172.21.15.31:0/4253147001 shutdown_connections 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e09217700 1 --2- 172.21.15.31:0/4253147001 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04133590 0x7f9e04133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e09217700 1 --2- 172.21.15.31:0/4253147001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0405dfb0 0x7f9e041330a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:12.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e09217700 1 -- 172.21.15.31:0/4253147001 >> 172.21.15.31:0/4253147001 conn(0x7f9e04060ee0 msgr2=0x7f9e040a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:12.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e09217700 1 -- 172.21.15.31:0/4253147001 shutdown_connections 2024-04-26T07:29:12.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.005+0000 7f9e09217700 1 -- 172.21.15.31:0/4253147001 wait complete. 2024-04-26T07:29:12.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.006+0000 7f9e09217700 1 Processor -- start 2024-04-26T07:29:12.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.006+0000 7f9e09217700 1 -- start start 2024-04-26T07:29:12.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e09217700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e0405dfb0 0x7f9e040a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:12.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e09217700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04067d70 0x7f9e04148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e09217700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e04133590 0x7f9e04149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e09217700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040a20e0 con 0x7f9e04133590 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e09217700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040a1170 con 0x7f9e0405dfb0 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e09217700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0409d600 con 0x7f9e04067d70 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e02d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e0405dfb0 0x7f9e040a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e0259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04067d70 0x7f9e04148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e0259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04067d70 0x7f9e04148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59906/0 (socket says 172.21.15.31:59906) 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e02d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e0405dfb0 0x7f9e040a07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:44550/0 (socket says 172.21.15.31:44550) 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e0259c700 1 -- 172.21.15.31:0/23671762 learned_addr learned my addr 172.21.15.31:0/23671762 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.007+0000 7f9e0359e700 1 --2- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e04133590 0x7f9e04149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9e02d9d700 1 -- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04067d70 msgr2=0x7f9e04148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9e02d9d700 1 --2- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04067d70 0x7f9e04148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:12.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9e02d9d700 1 -- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e04133590 msgr2=0x7f9e04149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9e02d9d700 1 --2- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e04133590 0x7f9e04149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9e02d9d700 1 -- 172.21.15.31:0/23671762 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc009470 con 0x7f9e0405dfb0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9e02d9d700 1 --2- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e0405dfb0 0x7f9e040a07a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f9df4000bc0 tx=0x7f9df4007840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9df3fff700 1 -- 172.21.15.31:0/23671762 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df40070d0 con 0x7f9e0405dfb0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9df3fff700 1 -- 172.21.15.31:0/23671762 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4007230 con 0x7f9e0405dfb0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df800b180 con 0x7f9e0405dfb0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9df3fff700 1 -- 172.21.15.31:0/23671762 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df4005610 con 0x7f9e0405dfb0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.008+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0409f030 con 0x7f9e0405dfb0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.009+0000 7f9df3fff700 1 -- 172.21.15.31:0/23671762 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9df401a060 con 0x7f9e0405dfb0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.009+0000 7f9df3fff700 1 -- 172.21.15.31:0/23671762 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9df4049d50 con 0x7f9e0405dfb0 2024-04-26T07:29:12.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.009+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e040a04c0 con 0x7f9e0405dfb0 2024-04-26T07:29:12.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.012+0000 7f9df3fff700 1 -- 172.21.15.31:0/23671762 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9e040a04c0 con 0x7f9e0405dfb0 2024-04-26T07:29:12.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.162+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e04133f10 con 0x7f9e0405dfb0 2024-04-26T07:29:12.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.163+0000 7f9df3fff700 1 -- 172.21.15.31:0/23671762 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f9e04133f10 con 0x7f9e0405dfb0 2024-04-26T07:29:12.163 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:12.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 >> v1:172.21.15.31:6816/39613 conn(0x7f9de0038da0 legacy=0x7f9de003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:12.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e0405dfb0 msgr2=0x7f9e040a07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:12.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 --2- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e0405dfb0 0x7f9e040a07a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f9df4000bc0 tx=0x7f9df4007840).stop 2024-04-26T07:29:12.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 shutdown_connections 2024-04-26T07:29:12.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 --2- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e04133590 0x7f9e04149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:12.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 --2- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e0405dfb0 0x7f9e040a07a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:12.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 --2- 172.21.15.31:0/23671762 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e04067d70 0x7f9e04148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:12.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 >> 172.21.15.31:0/23671762 conn(0x7f9e04060ee0 msgr2=0x7f9e04132990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:12.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 shutdown_connections 2024-04-26T07:29:12.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:12.164+0000 7f9e09217700 1 -- 172.21.15.31:0/23671762 wait complete. 2024-04-26T07:29:12.165 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:12.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:12.477 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:13.478 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:13.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.597+0000 7f16b8ff1700 1 Processor -- start 2024-04-26T07:29:13.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.597+0000 7f16b8ff1700 1 -- start start 2024-04-26T07:29:13.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b8ff1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b4096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:13.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b8ff1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b4141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b8ff1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b40970a0 con 0x7f16b406c7d0 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b8ff1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b4133c10 con 0x7f16b405c080 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b8ff1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b4096810 con 0x7f16b41360f0 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b1d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b4096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b2d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b4141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f16b406c7d0 0x7f16b405b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53340/0 (socket says 172.21.15.31:53340) 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b259c700 1 -- 172.21.15.31:0/3418058256 learned_addr learned my addr 172.21.15.31:0/3418058256 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b159a700 1 -- 172.21.15.31:0/3418058256 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908033804 0 0) 0x7f16b40970a0 con 0x7f16b406c7d0 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b2d9d700 1 -- 172.21.15.31:0/3418058256 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 msgr2=0x7f16b4096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b2d9d700 1 --2- 172.21.15.31:0/3418058256 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b4096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b2d9d700 1 -- 172.21.15.31:0/3418058256 >> v1:172.21.15.31:6789/0 conn(0x7f16b406c7d0 legacy=0x7f16b405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b2d9d700 1 -- 172.21.15.31:0/3418058256 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b41364d0 con 0x7f16b405c080 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b1d9b700 1 --2- 172.21.15.31:0/3418058256 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b4096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:13.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.598+0000 7f16b2d9d700 1 --2- 172.21.15.31:0/3418058256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b4141a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f16ac0032f0 tx=0x7f16ac0091d0).ready entity=mon.1 client_cookie=106650ca18eb0add server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b159a700 1 -- 172.21.15.31:0/3418058256 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16ac00b6c0 con 0x7f16b405c080 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b159a700 1 -- 172.21.15.31:0/3418058256 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac00b820 con 0x7f16b405c080 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b159a700 1 -- 172.21.15.31:0/3418058256 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16ac00b990 con 0x7f16b405c080 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3418058256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 msgr2=0x7f16b4141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b8ff1700 1 --2- 172.21.15.31:0/3418058256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b4141a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f16ac0032f0 tx=0x7f16ac0091d0).stop 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3418058256 shutdown_connections 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b8ff1700 1 --2- 172.21.15.31:0/3418058256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b4141a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b8ff1700 1 --2- 172.21.15.31:0/3418058256 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b4096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3418058256 >> 172.21.15.31:0/3418058256 conn(0x7f16b4061370 msgr2=0x7f16b406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3418058256 shutdown_connections 2024-04-26T07:29:13.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.599+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3418058256 wait complete. 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.600+0000 7f16b8ff1700 1 Processor -- start 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.600+0000 7f16b8ff1700 1 -- start start 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b8ff1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b40661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b8ff1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b406c7d0 0x7f16b4145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b8ff1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b41494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b8ff1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40659f0 con 0x7f16b406c7d0 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b8ff1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b4065cd0 con 0x7f16b405c080 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b8ff1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40666c0 con 0x7f16b41360f0 2024-04-26T07:29:13.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b406c7d0 0x7f16b4145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b40661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b406c7d0 0x7f16b4145fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39810/0 (socket says 172.21.15.31:39810) 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b1d9b700 1 -- 172.21.15.31:0/3209660893 learned_addr learned my addr 172.21.15.31:0/3209660893 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.601+0000 7f16b2d9d700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b41494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b259c700 1 -- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 msgr2=0x7f16b41494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b259c700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b41494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b259c700 1 -- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b406c7d0 msgr2=0x7f16b4145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b259c700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b406c7d0 0x7f16b4145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b259c700 1 -- 172.21.15.31:0/3209660893 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a800b180 con 0x7f16b405c080 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b1d9b700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b406c7d0 0x7f16b4145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b259c700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b40661d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f16a4000bc0 tx=0x7f16a40079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16a37fe700 1 -- 172.21.15.31:0/3209660893 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a400ce00 con 0x7f16b405c080 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16a37fe700 1 -- 172.21.15.31:0/3209660893 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a40070d0 con 0x7f16b405c080 2024-04-26T07:29:13.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac009470 con 0x7f16b405c080 2024-04-26T07:29:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16a37fe700 1 -- 172.21.15.31:0/3209660893 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16a4007430 con 0x7f16b405c080 2024-04-26T07:29:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.602+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b4146c60 con 0x7f16b405c080 2024-04-26T07:29:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.603+0000 7f16a37fe700 1 -- 172.21.15.31:0/3209660893 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f16a4010070 con 0x7f16b405c080 2024-04-26T07:29:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.603+0000 7f16a37fe700 1 -- 172.21.15.31:0/3209660893 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f16a4049d50 con 0x7f16b405c080 2024-04-26T07:29:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.603+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b4065e10 con 0x7f16b405c080 2024-04-26T07:29:13.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.607+0000 7f16a37fe700 1 -- 172.21.15.31:0/3209660893 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f16b4065e10 con 0x7f16b405c080 2024-04-26T07:29:13.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.755+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16b4136780 con 0x7f16b405c080 2024-04-26T07:29:13.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.755+0000 7f16a37fe700 1 -- 172.21.15.31:0/3209660893 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f16a4018020 con 0x7f16b405c080 2024-04-26T07:29:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 >> v1:172.21.15.31:6816/39613 conn(0x7f1690038e30 legacy=0x7f169003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 msgr2=0x7f16b40661d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b40661d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f16a4000bc0 tx=0x7f16a40079e0).stop 2024-04-26T07:29:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 shutdown_connections 2024-04-26T07:29:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f16b41360f0 0x7f16b41494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b405c080 0x7f16b40661d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 --2- 172.21.15.31:0/3209660893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b406c7d0 0x7f16b4145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 >> 172.21.15.31:0/3209660893 conn(0x7f16b4061370 msgr2=0x7f16b409aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:13.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 shutdown_connections 2024-04-26T07:29:13.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:13.757+0000 7f16b8ff1700 1 -- 172.21.15.31:0/3209660893 wait complete. 2024-04-26T07:29:13.759 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:14.071 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:14.071 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:15.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:15.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.191+0000 7f8e89472700 1 Processor -- start 2024-04-26T07:29:15.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.191+0000 7f8e89472700 1 -- start start 2024-04-26T07:29:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.191+0000 7f8e89472700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840aca60 0x7f8e840ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.191+0000 7f8e89472700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e8405cbb0 0x7f8e84139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e89472700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8405b970 con 0x7f8e840a8af0 2024-04-26T07:29:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e89472700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8405c3d0 con 0x7f8e840aca60 2024-04-26T07:29:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e89472700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8405d300 con 0x7f8e8405cbb0 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e837fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e8405cbb0 0x7f8e84139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e82ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840aca60 0x7f8e840ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e827fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8e840a8af0 0x7f8e84139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53344/0 (socket says 172.21.15.31:53344) 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e827fc700 1 -- 172.21.15.31:0/2875124263 learned_addr learned my addr 172.21.15.31:0/2875124263 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e837fe700 1 -- 172.21.15.31:0/2875124263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840aca60 msgr2=0x7f8e840ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e837fe700 1 --2- 172.21.15.31:0/2875124263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840aca60 0x7f8e840ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e837fe700 1 -- 172.21.15.31:0/2875124263 >> v1:172.21.15.31:6789/0 conn(0x7f8e840a8af0 legacy=0x7f8e84139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2875124263 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107285015 0 0) 0x7f8e8405b970 con 0x7f8e840a8af0 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e837fe700 1 -- 172.21.15.31:0/2875124263 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e840ac400 con 0x7f8e8405cbb0 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e82ffd700 1 --2- 172.21.15.31:0/2875124263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840aca60 0x7f8e840ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e837fe700 1 --2- 172.21.15.31:0/2875124263 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e8405cbb0 0x7f8e84139c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8e7c0032f0 tx=0x7f8e7c0091d0).ready entity=mon.2 client_cookie=95c80d132a872752 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2875124263 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7c00b6c0 con 0x7f8e8405cbb0 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2875124263 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c00b820 con 0x7f8e8405cbb0 2024-04-26T07:29:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.192+0000 7f8e81ffb700 1 -- 172.21.15.31:0/2875124263 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7c00b990 con 0x7f8e8405cbb0 2024-04-26T07:29:15.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.193+0000 7f8e89472700 1 -- 172.21.15.31:0/2875124263 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e8405cbb0 msgr2=0x7f8e84139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:15.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.193+0000 7f8e89472700 1 --2- 172.21.15.31:0/2875124263 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e8405cbb0 0x7f8e84139c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8e7c0032f0 tx=0x7f8e7c0091d0).stop 2024-04-26T07:29:15.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.193+0000 7f8e89472700 1 -- 172.21.15.31:0/2875124263 shutdown_connections 2024-04-26T07:29:15.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.193+0000 7f8e89472700 1 --2- 172.21.15.31:0/2875124263 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e8405cbb0 0x7f8e84139c20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:15.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.193+0000 7f8e89472700 1 --2- 172.21.15.31:0/2875124263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840aca60 0x7f8e840ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:15.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.193+0000 7f8e89472700 1 -- 172.21.15.31:0/2875124263 >> 172.21.15.31:0/2875124263 conn(0x7f8e84066d50 msgr2=0x7f8e84067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:15.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.193+0000 7f8e89472700 1 -- 172.21.15.31:0/2875124263 shutdown_connections 2024-04-26T07:29:15.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.193+0000 7f8e89472700 1 -- 172.21.15.31:0/2875124263 wait complete. 2024-04-26T07:29:15.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.194+0000 7f8e89472700 1 Processor -- start 2024-04-26T07:29:15.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.194+0000 7f8e89472700 1 -- start start 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e89472700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8405cbb0 0x7f8e84115660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e89472700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840a8af0 0x7f8e84148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e89472700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e840aca60 0x7f8e84148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e89472700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e841165d0 con 0x7f8e8405cbb0 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e89472700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e841168b0 con 0x7f8e840a8af0 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e89472700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84137f10 con 0x7f8e840aca60 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e82ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8405cbb0 0x7f8e84115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e837fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e840aca60 0x7f8e84148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e837fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e840aca60 0x7f8e84148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59942/0 (socket says 172.21.15.31:59942) 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e82ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8405cbb0 0x7f8e84115660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39824/0 (socket says 172.21.15.31:39824) 2024-04-26T07:29:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e837fe700 1 -- 172.21.15.31:0/2206772631 learned_addr learned my addr 172.21.15.31:0/2206772631 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e827fc700 1 --2- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840a8af0 0x7f8e84148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e837fe700 1 -- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840a8af0 msgr2=0x7f8e84148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e837fe700 1 --2- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840a8af0 0x7f8e84148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e837fe700 1 -- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8405cbb0 msgr2=0x7f8e84115660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e837fe700 1 --2- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8405cbb0 0x7f8e84115660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.195+0000 7f8e837fe700 1 -- 172.21.15.31:0/2206772631 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7400b180 con 0x7f8e840aca60 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.196+0000 7f8e837fe700 1 --2- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e840aca60 0x7f8e84148f50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8e7c0032f0 tx=0x7f8e7c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.196+0000 7f8e73fff700 1 -- 172.21.15.31:0/2206772631 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7c00b6c0 con 0x7f8e840aca60 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.196+0000 7f8e73fff700 1 -- 172.21.15.31:0/2206772631 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c021630 con 0x7f8e840aca60 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.196+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c009470 con 0x7f8e840aca60 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.196+0000 7f8e73fff700 1 -- 172.21.15.31:0/2206772631 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e7c011ea0 con 0x7f8e840aca60 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.196+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e84116030 con 0x7f8e840aca60 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.197+0000 7f8e73fff700 1 -- 172.21.15.31:0/2206772631 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8e7c027020 con 0x7f8e840aca60 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.197+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e84138110 con 0x7f8e840aca60 2024-04-26T07:29:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.197+0000 7f8e73fff700 1 -- 172.21.15.31:0/2206772631 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8e7c04bc10 con 0x7f8e840aca60 2024-04-26T07:29:15.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.200+0000 7f8e73fff700 1 -- 172.21.15.31:0/2206772631 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8e84138110 con 0x7f8e840aca60 2024-04-26T07:29:15.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.348+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e841380e0 con 0x7f8e840aca60 2024-04-26T07:29:15.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.349+0000 7f8e73fff700 1 -- 172.21.15.31:0/2206772631 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f8e7c015030 con 0x7f8e840aca60 2024-04-26T07:29:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:15.350 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:15.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 >> v1:172.21.15.31:6816/39613 conn(0x7f8e60038dd0 legacy=0x7f8e6003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:15.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e840aca60 msgr2=0x7f8e84148f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 --2- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e840aca60 0x7f8e84148f50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8e7c0032f0 tx=0x7f8e7c016000).stop 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 shutdown_connections 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 --2- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8e840aca60 0x7f8e84148f50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 --2- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8405cbb0 0x7f8e84115660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 --2- 172.21.15.31:0/2206772631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8e840a8af0 0x7f8e84148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 >> 172.21.15.31:0/2206772631 conn(0x7f8e84066d50 msgr2=0x7f8e840a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 shutdown_connections 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:15.350+0000 7f8e89472700 1 -- 172.21.15.31:0/2206772631 wait complete. 2024-04-26T07:29:15.352 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:15.663 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:15.664 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:16.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:16.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.784+0000 7fcde6bde700 1 Processor -- start 2024-04-26T07:29:16.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.784+0000 7fcde6bde700 1 -- start start 2024-04-26T07:29:16.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.784+0000 7fcde6bde700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde00a8380 0x7fcde0065870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:16.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.784+0000 7fcde6bde700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcde01374d0 0x7fcde00a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:16.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.784+0000 7fcde6bde700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde0064f90 con 0x7fcde00a9980 2024-04-26T07:29:16.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.784+0000 7fcde6bde700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde0065420 con 0x7fcde01374d0 2024-04-26T07:29:16.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde6bde700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0137960 con 0x7fcde00a8380 2024-04-26T07:29:16.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde497a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde00a8380 0x7fcde0065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde497a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde00a8380 0x7fcde0065870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59950/0 (socket says 172.21.15.31:59950) 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde497a700 1 -- 172.21.15.31:0/1187921423 learned_addr learned my addr 172.21.15.31:0/1187921423 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcddffff700 1 --2- 172.21.15.31:0/1187921423 >> v2:172.21.15.31:3300/0 conn(0x7fcde01374d0 0x7fcde00a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde497a700 1 -- 172.21.15.31:0/1187921423 >> v2:172.21.15.31:3300/0 conn(0x7fcde01374d0 msgr2=0x7fcde00a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde497a700 1 --2- 172.21.15.31:0/1187921423 >> v2:172.21.15.31:3300/0 conn(0x7fcde01374d0 0x7fcde00a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde497a700 1 -- 172.21.15.31:0/1187921423 >> v1:172.21.15.31:6789/0 conn(0x7fcde00a9980 legacy=0x7fcde005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde497a700 1 -- 172.21.15.31:0/1187921423 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0137c20 con 0x7fcde00a8380 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcde497a700 1 --2- 172.21.15.31:0/1187921423 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde00a8380 0x7fcde0065870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcdd4002f70 tx=0x7fcdd4006eb0).ready entity=mon.2 client_cookie=2e73b6e12408b2fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcddf7fe700 1 -- 172.21.15.31:0/1187921423 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd400d570 con 0x7fcde00a8380 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcddf7fe700 1 -- 172.21.15.31:0/1187921423 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd4000e90 con 0x7fcde00a8380 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.785+0000 7fcddf7fe700 1 -- 172.21.15.31:0/1187921423 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd400d900 con 0x7fcde00a8380 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.786+0000 7fcde6bde700 1 -- 172.21.15.31:0/1187921423 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde00a8380 msgr2=0x7fcde0065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.786+0000 7fcde6bde700 1 --2- 172.21.15.31:0/1187921423 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde00a8380 0x7fcde0065870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcdd4002f70 tx=0x7fcdd4006eb0).stop 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.786+0000 7fcde6bde700 1 -- 172.21.15.31:0/1187921423 shutdown_connections 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.786+0000 7fcde6bde700 1 --2- 172.21.15.31:0/1187921423 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde00a8380 0x7fcde0065870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:16.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.786+0000 7fcde6bde700 1 --2- 172.21.15.31:0/1187921423 >> v2:172.21.15.31:3300/0 conn(0x7fcde01374d0 0x7fcde00a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:16.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.786+0000 7fcde6bde700 1 -- 172.21.15.31:0/1187921423 >> 172.21.15.31:0/1187921423 conn(0x7fcde0061370 msgr2=0x7fcde006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:16.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.786+0000 7fcde6bde700 1 -- 172.21.15.31:0/1187921423 shutdown_connections 2024-04-26T07:29:16.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.786+0000 7fcde6bde700 1 -- 172.21.15.31:0/1187921423 wait complete. 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.787+0000 7fcde6bde700 1 Processor -- start 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.787+0000 7fcde6bde700 1 -- start start 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde6bde700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde00a8380 0x7fcde0065e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde6bde700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcde00a9980 0x7fcde0133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde6bde700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde0067580 0x7fcde0062000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde6bde700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0066940 con 0x7fcde00a8380 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde6bde700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0096880 con 0x7fcde00a9980 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde6bde700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0067cc0 con 0x7fcde0067580 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde00a8380 0x7fcde0065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde517b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde0067580 0x7fcde0062000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde00a8380 0x7fcde0065e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39844/0 (socket says 172.21.15.31:39844) 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 -- 172.21.15.31:0/839572948 learned_addr learned my addr 172.21.15.31:0/839572948 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcddffff700 1 --2- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcde00a9980 0x7fcde0133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 -- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde0067580 msgr2=0x7fcde0062000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 --2- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde0067580 0x7fcde0062000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 -- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcde00a9980 msgr2=0x7fcde0133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 --2- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcde00a9980 0x7fcde0133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 -- 172.21.15.31:0/839572948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd400b1e0 con 0x7fcde00a8380 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde497a700 1 --2- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde00a8380 0x7fcde0065e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fcdd4002f70 tx=0x7fcdd4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcdddffb700 1 -- 172.21.15.31:0/839572948 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd40116e0 con 0x7fcde00a8380 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcdddffb700 1 -- 172.21.15.31:0/839572948 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd4011840 con 0x7fcde00a8380 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcdddffb700 1 -- 172.21.15.31:0/839572948 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdd4011ba0 con 0x7fcde00a8380 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.788+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde00991f0 con 0x7fcde00a8380 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.789+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde00624f0 con 0x7fcde00a8380 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.789+0000 7fcdddffb700 1 -- 172.21.15.31:0/839572948 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fcdd4025030 con 0x7fcde00a8380 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.789+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde0098f50 con 0x7fcde00a8380 2024-04-26T07:29:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.790+0000 7fcdddffb700 1 -- 172.21.15.31:0/839572948 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcdd404ba10 con 0x7fcde00a8380 2024-04-26T07:29:16.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.793+0000 7fcdddffb700 1 -- 172.21.15.31:0/839572948 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcde0098f50 con 0x7fcde00a8380 2024-04-26T07:29:16.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.941+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcde0098f50 con 0x7fcde00a8380 2024-04-26T07:29:16.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.941+0000 7fcdddffb700 1 -- 172.21.15.31:0/839572948 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fcde0098f50 con 0x7fcde00a8380 2024-04-26T07:29:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:16.942 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:28:55.926887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4207,"mds_1":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6818/1834150302","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":1834150302}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 >> v1:172.21.15.31:6816/39613 conn(0x7fcdc0038e30 legacy=0x7fcdc003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde00a8380 msgr2=0x7fcde0065e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 --2- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde00a8380 0x7fcde0065e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fcdd4002f70 tx=0x7fcdd4015000).stop 2024-04-26T07:29:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 shutdown_connections 2024-04-26T07:29:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 --2- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcde0067580 0x7fcde0062000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 --2- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcde00a8380 0x7fcde0065e80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 --2- 172.21.15.31:0/839572948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcde00a9980 0x7fcde0133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 >> 172.21.15.31:0/839572948 conn(0x7fcde0061370 msgr2=0x7fcde0136d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 shutdown_connections 2024-04-26T07:29:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:16.942+0000 7fcde6bde700 1 -- 172.21.15.31:0/839572948 wait complete. 2024-04-26T07:29:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-26T07:29:17.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:28:55.926887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4207, 'mds_1': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6818/1834150302', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6818', 'nonce': 1834150302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:17.256 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4204:up:stopping 2024-04-26T07:29:18.008 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-04-26T07:29:18.258 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:29:18.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.377+0000 7f13ec0bd700 1 Processor -- start 2024-04-26T07:29:18.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.378+0000 7f13ec0bd700 1 -- start start 2024-04-26T07:29:18.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.378+0000 7f13ec0bd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e409e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.378+0000 7f13ec0bd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13e409c9e0 0x7f13e40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.378+0000 7f13ec0bd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e409f420 0x7f13e40a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.378+0000 7f13ec0bd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e409e2a0 con 0x7f13e409c9e0 2024-04-26T07:29:18.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.378+0000 7f13ec0bd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e409ce70 con 0x7f13e40a3170 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.378+0000 7f13ec0bd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13e409d110 con 0x7f13e409f420 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e409e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13ea65a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e409f420 0x7f13e40a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e409e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59362/0 (socket says 172.21.15.31:59362) 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13ea65a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e409f420 0x7f13e40a3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41646/0 (socket says 172.21.15.31:41646) 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 -- 172.21.15.31:0/3953373533 learned_addr learned my addr 172.21.15.31:0/3953373533 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9658700 1 --2- 172.21.15.31:0/3953373533 >> v2:172.21.15.31:3300/0 conn(0x7f13e409c9e0 0x7f13e40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 -- 172.21.15.31:0/3953373533 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e409f420 msgr2=0x7f13e40a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 --2- 172.21.15.31:0/3953373533 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e409f420 0x7f13e40a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 -- 172.21.15.31:0/3953373533 >> v2:172.21.15.31:3300/0 conn(0x7f13e409c9e0 msgr2=0x7f13e40a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 --2- 172.21.15.31:0/3953373533 >> v2:172.21.15.31:3300/0 conn(0x7f13e409c9e0 0x7f13e40a3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 -- 172.21.15.31:0/3953373533 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40a3f30 con 0x7f13e40a3170 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13ea65a700 1 --2- 172.21.15.31:0/3953373533 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e409f420 0x7f13e40a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9658700 1 --2- 172.21.15.31:0/3953373533 >> v2:172.21.15.31:3300/0 conn(0x7f13e409c9e0 0x7f13e40a3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e9e59700 1 --2- 172.21.15.31:0/3953373533 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e409e6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f13e409d030 tx=0x7f13e0006d70).ready entity=mon.1 client_cookie=b4f88a3f7e9b8a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e8e57700 1 -- 172.21.15.31:0/3953373533 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e0012070 con 0x7f13e40a3170 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e8e57700 1 -- 172.21.15.31:0/3953373533 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0000e90 con 0x7f13e40a3170 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.379+0000 7f13e8e57700 1 -- 172.21.15.31:0/3953373533 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e000fb90 con 0x7f13e40a3170 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 -- 172.21.15.31:0/3953373533 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 msgr2=0x7f13e409e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 --2- 172.21.15.31:0/3953373533 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e409e6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f13e409d030 tx=0x7f13e0006d70).stop 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 -- 172.21.15.31:0/3953373533 shutdown_connections 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 --2- 172.21.15.31:0/3953373533 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e409f420 0x7f13e40a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 --2- 172.21.15.31:0/3953373533 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e409e6f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 --2- 172.21.15.31:0/3953373533 >> v2:172.21.15.31:3300/0 conn(0x7f13e409c9e0 0x7f13e40a3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 -- 172.21.15.31:0/3953373533 >> 172.21.15.31:0/3953373533 conn(0x7f13e4060ee0 msgr2=0x7f13e40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 -- 172.21.15.31:0/3953373533 shutdown_connections 2024-04-26T07:29:18.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.380+0000 7f13ec0bd700 1 -- 172.21.15.31:0/3953373533 wait complete. 2024-04-26T07:29:18.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.381+0000 7f13ec0bd700 1 Processor -- start 2024-04-26T07:29:18.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.381+0000 7f13ec0bd700 1 -- start start 2024-04-26T07:29:18.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13ec0bd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e409f420 0x7f13e4144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13ec0bd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e4141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13ec0bd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e4144f20 0x7f13e4141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13ec0bd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e41410f0 con 0x7f13e409f420 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13ec0bd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4145400 con 0x7f13e40a3170 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13ec0bd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40a2bf0 con 0x7f13e4144f20 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9e59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e409f420 0x7f13e4144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9e59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e409f420 0x7f13e4144a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48382/0 (socket says 172.21.15.31:48382) 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9e59700 1 -- 172.21.15.31:0/1248347957 learned_addr learned my addr 172.21.15.31:0/1248347957 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13ea65a700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e4144f20 0x7f13e4141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9658700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e4141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9e59700 1 -- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e4144f20 msgr2=0x7f13e4141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9e59700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e4144f20 0x7f13e4141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9e59700 1 -- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 msgr2=0x7f13e4141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9e59700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e4141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.382+0000 7f13e9e59700 1 -- 172.21.15.31:0/1248347957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d800b180 con 0x7f13e409f420 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.383+0000 7f13e9e59700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e409f420 0x7f13e4144a30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f13e409d030 tx=0x7f13e001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.383+0000 7f13d6ffd700 1 -- 172.21.15.31:0/1248347957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e0016720 con 0x7f13e409f420 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.383+0000 7f13d6ffd700 1 -- 172.21.15.31:0/1248347957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0016880 con 0x7f13e409f420 2024-04-26T07:29:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.383+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc009470 con 0x7f13e409f420 2024-04-26T07:29:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.383+0000 7f13d6ffd700 1 -- 172.21.15.31:0/1248347957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e0016be0 con 0x7f13e409f420 2024-04-26T07:29:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.383+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e000d660 con 0x7f13e409f420 2024-04-26T07:29:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.384+0000 7f13d6ffd700 1 -- 172.21.15.31:0/1248347957 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f13e0029030 con 0x7f13e409f420 2024-04-26T07:29:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.384+0000 7f13d6ffd700 1 -- 172.21.15.31:0/1248347957 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f13e004f880 con 0x7f13e409f420 2024-04-26T07:29:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.384+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e4144880 con 0x7f13e409f420 2024-04-26T07:29:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.387+0000 7f13d6ffd700 1 -- 172.21.15.31:0/1248347957 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f13e0024200 con 0x7f13e409f420 2024-04-26T07:29:18.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.537+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13e4144690 con 0x7f13e409f420 2024-04-26T07:29:18.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.538+0000 7f13d6ffd700 1 -- 172.21.15.31:0/1248347957 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2017 (secure 0 0 0) 0x7f13e00056f0 con 0x7f13e409f420 2024-04-26T07:29:18.539 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:18.539 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:29:17.982188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:29:18.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 >> v1:172.21.15.31:6816/39613 conn(0x7f13c4038da0 legacy=0x7f13c403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e409f420 msgr2=0x7f13e4144a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e409f420 0x7f13e4144a30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f13e409d030 tx=0x7f13e001a000).stop 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 shutdown_connections 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13e4144f20 0x7f13e4141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e409f420 0x7f13e4144a30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 --2- 172.21.15.31:0/1248347957 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13e40a3170 0x7f13e4141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 >> 172.21.15.31:0/1248347957 conn(0x7f13e4060ee0 msgr2=0x7f13e405dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 shutdown_connections 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.539+0000 7f13ec0bd700 1 -- 172.21.15.31:0/1248347957 wait complete. 2024-04-26T07:29:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 13 2024-04-26T07:29:18.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T07:28:31.131715+0000', 'modified': '2024-04-26T07:29:17.982188+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4207}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4207': {'gid': 4207, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/4068193720', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 4068193720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-26T07:29:18.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T07:29:18.853 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T07:29:18.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.961+0000 7f590086e700 1 Processor -- start 2024-04-26T07:29:18.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.961+0000 7f590086e700 1 -- start start 2024-04-26T07:29:18.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.961+0000 7f590086e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58fc1374d0 0x7f58fc065870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.961+0000 7f590086e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0a8760 0x7f58fc13e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.961+0000 7f590086e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc064f90 con 0x7f58fc0a8380 2024-04-26T07:29:18.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.961+0000 7f590086e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc065420 con 0x7f58fc1374d0 2024-04-26T07:29:18.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.961+0000 7f590086e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc137960 con 0x7f58fc0a8760 2024-04-26T07:29:18.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58fad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0a8760 0x7f58fc13e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f9d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58fc1374d0 0x7f58fc065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58fa59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f58fc0a8380 0x7f58fc0a9980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46314/0 (socket says 172.21.15.31:46314) 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58fad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0a8760 0x7f58fc13e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59390/0 (socket says 172.21.15.31:59390) 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58fa59c700 1 -- 172.21.15.31:0/437164193 learned_addr learned my addr 172.21.15.31:0/437164193 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f9d9b700 1 -- 172.21.15.31:0/437164193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0a8760 msgr2=0x7f58fc13e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f9d9b700 1 --2- 172.21.15.31:0/437164193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0a8760 0x7f58fc13e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f9d9b700 1 -- 172.21.15.31:0/437164193 >> v1:172.21.15.31:6789/0 conn(0x7f58fc0a8380 legacy=0x7f58fc0a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f9d9b700 1 -- 172.21.15.31:0/437164193 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc137c20 con 0x7f58fc1374d0 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58fad9d700 1 --2- 172.21.15.31:0/437164193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0a8760 0x7f58fc13e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f9d9b700 1 --2- 172.21.15.31:0/437164193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc1374d0 0x7f58fc065870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f58f0002f70 tx=0x7f58f0006df0).ready entity=mon.0 client_cookie=f08698f96733ad7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f959a700 1 -- 172.21.15.31:0/437164193 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f000d570 con 0x7f58fc1374d0 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f959a700 1 -- 172.21.15.31:0/437164193 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f0000e90 con 0x7f58fc1374d0 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.962+0000 7f58f959a700 1 -- 172.21.15.31:0/437164193 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f000d8c0 con 0x7f58fc1374d0 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.963+0000 7f590086e700 1 -- 172.21.15.31:0/437164193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc1374d0 msgr2=0x7f58fc065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.963+0000 7f590086e700 1 --2- 172.21.15.31:0/437164193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc1374d0 0x7f58fc065870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f58f0002f70 tx=0x7f58f0006df0).stop 2024-04-26T07:29:18.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.963+0000 7f590086e700 1 -- 172.21.15.31:0/437164193 shutdown_connections 2024-04-26T07:29:18.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.963+0000 7f590086e700 1 --2- 172.21.15.31:0/437164193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0a8760 0x7f58fc13e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.963+0000 7f590086e700 1 --2- 172.21.15.31:0/437164193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc1374d0 0x7f58fc065870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.963+0000 7f590086e700 1 -- 172.21.15.31:0/437164193 >> 172.21.15.31:0/437164193 conn(0x7f58fc061370 msgr2=0x7f58fc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:18.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.963+0000 7f590086e700 1 -- 172.21.15.31:0/437164193 shutdown_connections 2024-04-26T07:29:18.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.963+0000 7f590086e700 1 -- 172.21.15.31:0/437164193 wait complete. 2024-04-26T07:29:18.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f590086e700 1 Processor -- start 2024-04-26T07:29:18.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f590086e700 1 -- start start 2024-04-26T07:29:18.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f590086e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc0a8380 0x7f58fc092710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f590086e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58fc0a8760 0x7f58fc146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f590086e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0950d0 0x7f58fc147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f590086e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0941e0 con 0x7f58fc0a8380 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f590086e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc093420 con 0x7f58fc0950d0 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f590086e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc092eb0 con 0x7f58fc0a8760 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc0a8380 0x7f58fc092710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc0a8380 0x7f58fc092710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48408/0 (socket says 172.21.15.31:48408) 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f58f9d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58fc0a8760 0x7f58fc146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f58fa59c700 1 -- 172.21.15.31:0/1862648149 learned_addr learned my addr 172.21.15.31:0/1862648149 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.964+0000 7f58fad9d700 1 --2- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0950d0 0x7f58fc147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58fa59c700 1 -- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58fc0a8760 msgr2=0x7f58fc146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58fa59c700 1 --2- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58fc0a8760 0x7f58fc146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58fa59c700 1 -- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0950d0 msgr2=0x7f58fc147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58fa59c700 1 --2- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0950d0 0x7f58fc147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58fa59c700 1 -- 172.21.15.31:0/1862648149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4009470 con 0x7f58fc0a8380 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58fa59c700 1 --2- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc0a8380 0x7f58fc092710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f58fc093560 tx=0x7f58ec007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58eb7fe700 1 -- 172.21.15.31:0/1862648149 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58ec0070d0 con 0x7f58fc0a8380 2024-04-26T07:29:18.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58eb7fe700 1 -- 172.21.15.31:0/1862648149 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec007230 con 0x7f58fc0a8380 2024-04-26T07:29:18.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f590086e700 1 -- 172.21.15.31:0/1862648149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f000b180 con 0x7f58fc0a8380 2024-04-26T07:29:18.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f58eb7fe700 1 -- 172.21.15.31:0/1862648149 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58ec005610 con 0x7f58fc0a8380 2024-04-26T07:29:18.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.965+0000 7f590086e700 1 -- 172.21.15.31:0/1862648149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc0943c0 con 0x7f58fc0a8380 2024-04-26T07:29:18.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.966+0000 7f58eb7fe700 1 -- 172.21.15.31:0/1862648149 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f58ec010070 con 0x7f58fc0a8380 2024-04-26T07:29:18.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.966+0000 7f58eb7fe700 1 -- 172.21.15.31:0/1862648149 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f58ec049df0 con 0x7f58fc0a8380 2024-04-26T07:29:18.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.969+0000 7f59122f5b80 1 Processor -- start 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.969+0000 7f59122f5b80 1 -- start start 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44d99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa447aa10 con 0x564fa44d91d0 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fa441fe10 con 0x564fa44de590 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x564fa43f08b0 con 0x564fa44d95b0 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48422/0 (socket says 172.21.15.31:48422) 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 -- 172.21.15.31:0/2270664272 learned_addr learned my addr 172.21.15.31:0/2270664272 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58f9d9b700 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44d99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fad9d700 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 -- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 msgr2=0x564fa44d99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44d99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 -- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 msgr2=0x564fa44dea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 -- 172.21.15.31:0/2270664272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fa4486e20 con 0x564fa44d91d0 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58f9d9b700 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44d99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fad9d700 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.970+0000 7f58fa59c700 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cca60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f58ec0083f0 tx=0x7f58ec013000).ready entity=mon.0 client_cookie=5b8d1960aac75d8c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f590086e700 1 -- 172.21.15.31:0/2270664272 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58ec032310 con 0x564fa44d91d0 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f590086e700 1 -- 172.21.15.31:0/2270664272 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec030d50 con 0x564fa44d91d0 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f590086e700 1 -- 172.21.15.31:0/2270664272 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58ec008230 con 0x564fa44d91d0 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 -- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 msgr2=0x564fa44cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cca60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f58ec0083f0 tx=0x7f58ec013000).stop 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 -- 172.21.15.31:0/2270664272 shutdown_connections 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cca60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 --2- 172.21.15.31:0/2270664272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44d99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 -- 172.21.15.31:0/2270664272 >> 172.21.15.31:0/2270664272 conn(0x564fa4478970 msgr2=0x564fa43d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 -- 172.21.15.31:0/2270664272 shutdown_connections 2024-04-26T07:29:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.971+0000 7f59122f5b80 1 -- 172.21.15.31:0/2270664272 wait complete. 2024-04-26T07:29:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 1 -- start start 2024-04-26T07:29:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 1 Processor -- start 2024-04-26T07:29:18.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa4404180 con 0x564fa44d91d0 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fa43e47f0 con 0x564fa44de590 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x564fa43d4710 con 0x564fa44d95b0 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.972+0000 7f59122f5b80 10 client.0 ll_register_callbacks cb 0x564fa43f9570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48424/0 (socket says 172.21.15.31:48424) 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 -- 172.21.15.31:0/612585494 learned_addr learned my addr 172.21.15.31:0/612585494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58f9d9b700 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 -- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 msgr2=0x564fa44dcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44dcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 -- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 msgr2=0x564fa44dd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 -- 172.21.15.31:0/612585494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc137c20 con 0x564fa44d91d0 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fad9d700 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:18.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58fa59c700 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cfc40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x564fa44cbf50 tx=0x7f58ec024000).ready entity=mon.0 client_cookie=419949dbe71bf5d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58d57fa700 1 -- 172.21.15.31:0/612585494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58ec032310 con 0x564fa44d91d0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58d57fa700 1 -- 172.21.15.31:0/612585494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f58ec02e0d0 con 0x564fa44d91d0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f59122f5b80 1 -- 172.21.15.31:0/612585494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564fa437b0c0 con 0x564fa44d91d0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58d57fa700 1 -- 172.21.15.31:0/612585494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58ec02e290 con 0x564fa44d91d0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f59122f5b80 10 client.4923 fetch_fsmap learned FSMap version 13 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f59122f5b80 1 -- 172.21.15.31:0/612585494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x7f58f4009b30 con 0x564fa44d91d0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58d57fa700 1 -- 172.21.15.31:0/612585494 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564fa437b0c0 con 0x564fa44d91d0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f58d57fa700 1 -- 172.21.15.31:0/612585494 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 13) v1 ==== 1181+0+0 (secure 0 0 0) 0x7f58ec02e3f0 con 0x564fa44d91d0 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f59122f5b80 10 client.4923 fetch_fsmap finished waiting for FSMap version 13 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f59122f5b80 10 client.4923 resolve_mds: resolved ID 'c' to GID 4207 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f59122f5b80 20 client.4923 populate_metadata read hostname 'smithi031' 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f59122f5b80 4 client.4923 mds_command: new command op to 4207 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.973+0000 7f59122f5b80 1 -- 172.21.15.31:0/612585494 --> v1:172.21.15.31:6819/4068193720 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564fa43fa230 con 0x564fa44e7a80 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.974+0000 7f58d57fa700 10 client.4923 ms_handle_connect on v1:172.21.15.31:6819/4068193720 2024-04-26T07:29:18.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.974+0000 7f58d57fa700 1 -- 172.21.15.31:0/612585494 <== mds.0 v1:172.21.15.31:6819/4068193720 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x564fa43fa230 con 0x564fa44e7a80 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.974+0000 7f58d57fa700 10 client.4923 handle_command_reply: tid=0 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.974+0000 7f59122f5b80 1 client.4923 shutdown 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.974+0000 7f59122f5b80 1 -- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 msgr2=0x564fa44cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.974+0000 7f59122f5b80 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cfc40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x564fa44cbf50 tx=0x7f58ec024000).stop 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f59122f5b80 1 -- 172.21.15.31:0/612585494 shutdown_connections 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f59122f5b80 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa44dd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f59122f5b80 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa44cfc40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f59122f5b80 1 --2- 172.21.15.31:0/612585494 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa44dcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f58d57fa700 0 client.4923 ms_handle_reset on v1:172.21.15.31:6819/4068193720 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f59122f5b80 1 -- 172.21.15.31:0/612585494 >> 172.21.15.31:0/612585494 conn(0x564fa4478970 msgr2=0x564fa43cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f59122f5b80 1 -- 172.21.15.31:0/612585494 shutdown_connections 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f59122f5b80 1 -- 172.21.15.31:0/612585494 wait complete. 2024-04-26T07:29:18.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.975+0000 7f59122f5b80 20 client.4923 trim_cache size 0 max 16384 2024-04-26T07:29:18.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.993+0000 7f59122f5b80 1 Processor -- start 2024-04-26T07:29:18.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.993+0000 7f59122f5b80 1 -- start start 2024-04-26T07:29:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44d91d0 0x564fa44cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d95b0 0x564fa44cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44de590 0x564fa44dddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa437b2f0 con 0x564fa44d95b0 2024-04-26T07:29:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fa44d64c0 con 0x564fa44d91d0 2024-04-26T07:29:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x564fa44ce750 con 0x564fa44de590 2024-04-26T07:29:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58f9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d95b0 0x564fa44cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58fad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44de590 0x564fa44dddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58f9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d95b0 0x564fa44cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48436/0 (socket says 172.21.15.31:48436) 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58f9d9b700 1 -- 172.21.15.31:0/497773320 learned_addr learned my addr 172.21.15.31:0/497773320 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44d91d0 0x564fa44cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58fad9d700 1 -- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44d91d0 msgr2=0x564fa44cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58fad9d700 1 --2- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44d91d0 0x564fa44cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58fad9d700 1 -- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d95b0 msgr2=0x564fa44cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58fad9d700 1 --2- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d95b0 0x564fa44cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.994+0000 7f58fad9d700 1 -- 172.21.15.31:0/497773320 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fa43c9600 con 0x564fa44de590 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f58f9d9b700 1 --2- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d95b0 0x564fa44cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f58fad9d700 1 --2- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44de590 0x564fa44dddd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x564fa44ac1c0 tx=0x7f58f40091d0).ready entity=mon.2 client_cookie=a8987a07c287d6cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f58d77fe700 1 -- 172.21.15.31:0/497773320 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f401a070 con 0x564fa44de590 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f58d77fe700 1 -- 172.21.15.31:0/497773320 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f4015630 con 0x564fa44de590 2024-04-26T07:29:18.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f58d77fe700 1 -- 172.21.15.31:0/497773320 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f40159d0 con 0x564fa44de590 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f59122f5b80 1 -- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44de590 msgr2=0x564fa44dddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f59122f5b80 1 --2- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44de590 0x564fa44dddd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x564fa44ac1c0 tx=0x7f58f40091d0).stop 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f59122f5b80 1 -- 172.21.15.31:0/497773320 shutdown_connections 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f59122f5b80 1 --2- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44de590 0x564fa44dddd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f59122f5b80 1 --2- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44d91d0 0x564fa44cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f59122f5b80 1 --2- 172.21.15.31:0/497773320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d95b0 0x564fa44cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.995+0000 7f59122f5b80 1 -- 172.21.15.31:0/497773320 >> 172.21.15.31:0/497773320 conn(0x564fa4478970 msgr2=0x564fa43cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.996+0000 7f59122f5b80 1 -- 172.21.15.31:0/497773320 shutdown_connections 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.996+0000 7f59122f5b80 1 -- 172.21.15.31:0/497773320 wait complete. 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.996+0000 7f59122f5b80 1 -- start start 2024-04-26T07:29:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.996+0000 7f59122f5b80 1 Processor -- start 2024-04-26T07:29:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa4512870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa453b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f59122f5b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa453bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fa453b1a0 con 0x564fa44d91d0 2024-04-26T07:29:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fa453b440 con 0x564fa44de590 2024-04-26T07:29:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f59122f5b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x564fa4538e10 con 0x564fa44d95b0 2024-04-26T07:29:19.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f59122f5b80 10 client.0 ll_register_callbacks cb 0x564fa44d2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa4512870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f58fad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa453bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f58fa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa4512870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48444/0 (socket says 172.21.15.31:48444) 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f58fa59c700 1 -- 172.21.15.31:0/2229610895 learned_addr learned my addr 172.21.15.31:0/2229610895 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f58f9d9b700 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa453b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f58fad9d700 1 -- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 msgr2=0x564fa453b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.997+0000 7f58fad9d700 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa453b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58fad9d700 1 -- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 msgr2=0x564fa4512870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58fad9d700 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa4512870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58fad9d700 1 -- 172.21.15.31:0/2229610895 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f000d8b0 con 0x564fa44de590 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58fa59c700 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa4512870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58fad9d700 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa453bc00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x564fa44ac1c0 tx=0x7f58f4020000).ready entity=mon.1 client_cookie=923c85fabe108d1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3301/0 2024-04-26T07:29:19.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58d67fc700 1 -- 172.21.15.31:0/2229610895 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f401f630 con 0x564fa44de590 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58d67fc700 1 -- 172.21.15.31:0/2229610895 <== mon.1 v2:172.21.15.31:3301/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f58f401f790 con 0x564fa44de590 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f59122f5b80 1 -- 172.21.15.31:0/2229610895 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58ec030d50 con 0x564fa44de590 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58d67fc700 1 -- 172.21.15.31:0/2229610895 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58f401f950 con 0x564fa44de590 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f59122f5b80 10 client.4693 fetch_fsmap learned FSMap version 14 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f59122f5b80 1 -- 172.21.15.31:0/2229610895 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f58f40146c0 con 0x564fa44de590 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58d67fc700 1 -- 172.21.15.31:0/2229610895 <== mon.1 v2:172.21.15.31:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec030d50 con 0x564fa44de590 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58d67fc700 1 -- 172.21.15.31:0/2229610895 <== mon.1 v2:172.21.15.31:3301/0 5 ==== fsmap(e 14) v1 ==== 1333+0+0 (secure 0 0 0) 0x7f58f401d030 con 0x564fa44de590 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f59122f5b80 10 client.4693 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f59122f5b80 10 client.4693 resolve_mds: resolved ID 'c' to GID 4207 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f59122f5b80 20 client.4693 populate_metadata read hostname 'smithi031' 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f59122f5b80 4 client.4693 mds_command: new command op to 4207 tid=0[{"prefix": "status"}] 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f59122f5b80 1 -- 172.21.15.31:0/2229610895 --> v1:172.21.15.31:6819/4068193720 -- command(tid 0: {"prefix": "status"}) v1 -- 0x564fa43f2570 con 0x564fa44e7210 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.998+0000 7f58d67fc700 10 client.4693 ms_handle_connect on v1:172.21.15.31:6819/4068193720 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f58d67fc700 1 -- 172.21.15.31:0/2229610895 <== mds.0 v1:172.21.15.31:6819/4068193720 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+306 (unknown 0 0 3393874949) 0x564fa43f2570 con 0x564fa44e7210 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f58d67fc700 10 client.4693 handle_command_reply: tid=0 2024-04-26T07:29:19.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 client.4693 shutdown 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 -- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 msgr2=0x564fa453bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa453bc00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x564fa44ac1c0 tx=0x7f58f4020000).stop 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 -- 172.21.15.31:0/2229610895 shutdown_connections 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x564fa44de590 0x564fa453bc00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564fa44d91d0 0x564fa4512870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 --2- 172.21.15.31:0/2229610895 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x564fa44d95b0 0x564fa453b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f58d67fc700 0 client.4693 ms_handle_reset on v1:172.21.15.31:6819/4068193720 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 -- 172.21.15.31:0/2229610895 >> 172.21.15.31:0/2229610895 conn(0x564fa4478970 msgr2=0x564fa43cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 -- 172.21.15.31:0/2229610895 shutdown_connections 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 1 -- 172.21.15.31:0/2229610895 wait complete. 2024-04-26T07:29:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:18.999+0000 7f59122f5b80 20 client.4693 trim_cache size 0 max 16384 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "1efcad47-d196-4e33-a2f1-15c92eeb84f0", 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4207, 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 47.866583132000002, 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 13, 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 19, 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 19, 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 56.866192816000002 2024-04-26T07:29:19.007 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-26T07:29:19.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 -- 172.21.15.31:0/1862648149 >> v1:172.21.15.31:6816/39613 conn(0x7f58d8038da0 legacy=0x7f58d803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:19.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 -- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc0a8380 msgr2=0x7f58fc092710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:19.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 --2- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc0a8380 0x7f58fc092710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f58fc093560 tx=0x7f58ec007c40).stop 2024-04-26T07:29:19.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 -- 172.21.15.31:0/1862648149 shutdown_connections 2024-04-26T07:29:19.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 --2- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58fc0950d0 0x7f58fc147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:19.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 --2- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58fc0a8380 0x7f58fc092710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:19.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 --2- 172.21.15.31:0/1862648149 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58fc0a8760 0x7f58fc146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:19.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 -- 172.21.15.31:0/1862648149 >> 172.21.15.31:0/1862648149 conn(0x7f58fc061370 msgr2=0x7f58fc1367d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:19.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 -- 172.21.15.31:0/1862648149 shutdown_connections 2024-04-26T07:29:19.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:19.000+0000 7f590086e700 1 -- 172.21.15.31:0/1862648149 wait complete. 2024-04-26T07:29:19.011 INFO:teuthology.run_tasks:Running task print... 2024-04-26T07:29:19.021 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2024-04-26T07:29:19.021 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-04-26T07:29:19.064 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'quincy'}} overrides {'flavor': 'default', 'sha1': '19b26365dac54ee709df8c5dc2a7b7e89a50aba5'} 2024-04-26T07:29:19.065 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2024-04-26T07:29:19.065 INFO:teuthology.task.install:remote ubuntu@smithi031.front.sepia.ceph.com config {'branch': 'quincy', 'flavor': 'default'} 2024-04-26T07:29:19.065 INFO:teuthology.task.install:extra packages: [] 2024-04-26T07:29:19.070 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T07:29:19.070 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-04-26T07:29:19.071 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-04-26T07:29:19.094 INFO:teuthology.orchestra.run.smithi031.stdout:15.2.17-0.el8 2024-04-26T07:29:19.094 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.17-0.el8 2024-04-26T07:29:19.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-26T07:29:19.447 INFO:teuthology.task.install:Ceph rpm upgrade from 15.2.17-0.el8 to 17.2.7-904.gd8c6b0a3 2024-04-26T07:29:19.447 INFO:teuthology.task.install.rpm:Host smithi031 is: centos 8 x86_64 2024-04-26T07:29:19.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-26T07:29:19.784 INFO:teuthology.task.install.rpm:Repo base URL: https://1.chacra.ceph.com/r/ceph/quincy/d8c6b0a3ba8ca216f4aadb85bc7242e7c3b18d34/centos/8/flavors/default/ 2024-04-26T07:29:19.784 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-04-26T07:29:19.993 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/d8c6b0a3ba8ca216f4aadb85bc7242e7c3b18d34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/d8c6b0a3ba8ca216f4aadb85bc7242e7c3b18d34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/d8c6b0a3ba8ca216f4aadb85bc7242e7c3b18d34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T07:29:19.993 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-26T07:29:19.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T07:29:20.026 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T07:29:20.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T07:29:20.170 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T07:29:20.230 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-04-26T07:29:20.242 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-04-26T07:29:20.516 INFO:teuthology.orchestra.run.smithi031.stdout:71 files removed 2024-04-26T07:29:20.545 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-04-26T07:29:21.251 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 941 B/s | 257 B 00:00 2024-04-26T07:29:21.777 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 31 kB/s | 15 kB 00:00 2024-04-26T07:29:22.111 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 5.6 kB/s | 1.7 kB 00:00 2024-04-26T07:29:24.037 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - AppStream 15 MB/s | 28 MB 00:01 2024-04-26T07:29:29.904 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 10 MB 00:00 2024-04-26T07:29:32.129 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras 36 kB/s | 18 kB 00:00 2024-04-26T07:29:32.680 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 7.7 kB 00:00 2024-04-26T07:29:33.532 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - PowerTools 6.6 MB/s | 5.0 MB 00:00 2024-04-26T07:29:34.650 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-26T07:29:35.870 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2024-04-26T07:29:39.860 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 425 kB/s | 24 kB 00:00 2024-04-26T07:29:43.713 INFO:teuthology.orchestra.run.smithi031.stderr:Package cephadm available, but not installed. 2024-04-26T07:29:43.713 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: cephadm 2024-04-26T07:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-mgr-dashboard available, but not installed. 2024-04-26T07:29:43.719 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-mgr-dashboard 2024-04-26T07:29:43.720 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2024-04-26T07:29:43.720 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-04-26T07:29:43.720 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-mgr-rook available, but not installed. 2024-04-26T07:29:43.721 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-mgr-rook 2024-04-26T07:29:43.721 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-04-26T07:29:43.721 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-mgr-cephadm 2024-04-26T07:29:43.724 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-volume available, but not installed. 2024-04-26T07:29:43.724 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-volume 2024-04-26T07:29:43.823 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-26T07:29:43.824 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-26T07:29:43.824 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-26T07:29:43.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-26T07:29:44.278 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T07:29:44.303 INFO:teuthology.orchestra.run.smithi031.stdout:15.2.17-0.el8 2024-04-26T07:29:44.303 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-26T07:29:44.304 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 405, in upgrade upgrade_common(ctx, config, upgrade_old_style) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 351, in upgrade_common verify_package_version(ctx, node, remote) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 57, in verify_package_version raise RuntimeError( RuntimeError: ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8. 2024-04-26T07:29:44.524 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=af5dd03b2d34485aae381892b6711fae Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 405, in upgrade upgrade_common(ctx, config, upgrade_old_style) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 351, in upgrade_common verify_package_version(ctx, node, remote) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 57, in verify_package_version raise RuntimeError( RuntimeError: ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8. 2024-04-26T07:29:44.526 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-04-26T07:29:44.571 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T07:29:44.581 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T07:29:44.581 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:29:44.581 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T07:29:44.609 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:29:44.610 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T07:29:44.671 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:29:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.791+0000 7fc2189bf700 1 Processor -- start 2024-04-26T07:29:44.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.791+0000 7fc2189bf700 1 -- start start 2024-04-26T07:29:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc2189bf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc214065280 0x7fc2140635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc2189bf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc21413e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc2189bf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21409c5e0 con 0x7fc214134460 2024-04-26T07:29:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc2189bf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc214134240 con 0x7fc214065280 2024-04-26T07:29:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc2189bf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140656f0 con 0x7fc214063aa0 2024-04-26T07:29:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc212d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc21413e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc211d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc214065280 0x7fc2140635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc21259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc214134460 0x7fc214134840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59424/0 (socket says 172.21.15.31:59424) 2024-04-26T07:29:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc21259c700 1 -- 172.21.15.31:0/1537883428 learned_addr learned my addr 172.21.15.31:0/1537883428 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc212d9d700 1 -- 172.21.15.31:0/1537883428 >> v2:172.21.15.31:3300/0 conn(0x7fc214065280 msgr2=0x7fc2140635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc212d9d700 1 --2- 172.21.15.31:0/1537883428 >> v2:172.21.15.31:3300/0 conn(0x7fc214065280 0x7fc2140635b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc212d9d700 1 -- 172.21.15.31:0/1537883428 >> v1:172.21.15.31:6789/0 conn(0x7fc214134460 legacy=0x7fc214134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc21159a700 1 -- 172.21.15.31:0/1537883428 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253939044 0 0) 0x7fc21409c5e0 con 0x7fc214134460 2024-04-26T07:29:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc212d9d700 1 -- 172.21.15.31:0/1537883428 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21409bb10 con 0x7fc214063aa0 2024-04-26T07:29:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc211d9b700 1 --2- 172.21.15.31:0/1537883428 >> v2:172.21.15.31:3300/0 conn(0x7fc214065280 0x7fc2140635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.792+0000 7fc212d9d700 1 --2- 172.21.15.31:0/1537883428 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc21413e840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc20c0032f0 tx=0x7fc20c0091d0).ready entity=mon.2 client_cookie=d4f76f112d5f7a80 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc21159a700 1 -- 172.21.15.31:0/1537883428 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20c00b6c0 con 0x7fc214063aa0 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc21159a700 1 -- 172.21.15.31:0/1537883428 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00b820 con 0x7fc214063aa0 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc21159a700 1 -- 172.21.15.31:0/1537883428 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20c00b990 con 0x7fc214063aa0 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc2189bf700 1 -- 172.21.15.31:0/1537883428 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 msgr2=0x7fc21413e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc2189bf700 1 --2- 172.21.15.31:0/1537883428 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc21413e840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc20c0032f0 tx=0x7fc20c0091d0).stop 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc2189bf700 1 -- 172.21.15.31:0/1537883428 shutdown_connections 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc2189bf700 1 --2- 172.21.15.31:0/1537883428 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc21413e840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc2189bf700 1 --2- 172.21.15.31:0/1537883428 >> v2:172.21.15.31:3300/0 conn(0x7fc214065280 0x7fc2140635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc2189bf700 1 -- 172.21.15.31:0/1537883428 >> 172.21.15.31:0/1537883428 conn(0x7fc21405cfb0 msgr2=0x7fc214062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc2189bf700 1 -- 172.21.15.31:0/1537883428 shutdown_connections 2024-04-26T07:29:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.793+0000 7fc2189bf700 1 -- 172.21.15.31:0/1537883428 wait complete. 2024-04-26T07:29:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.794+0000 7fc2189bf700 1 Processor -- start 2024-04-26T07:29:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.794+0000 7fc2189bf700 1 -- start start 2024-04-26T07:29:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2189bf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc214136240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2189bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc214065280 0x7fc214148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2189bf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc214134460 0x7fc2141492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2189bf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc214096ac0 con 0x7fc214134460 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2189bf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21405fd70 con 0x7fc214065280 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2189bf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140a9260 con 0x7fc214063aa0 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc214136240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc212d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc214134460 0x7fc2141492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc211d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc214065280 0x7fc214148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc214136240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54136/0 (socket says 172.21.15.31:54136) 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 -- 172.21.15.31:0/2860409954 learned_addr learned my addr 172.21.15.31:0/2860409954 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 -- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc214065280 msgr2=0x7fc214148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 --2- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc214065280 0x7fc214148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 -- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc214134460 msgr2=0x7fc2141492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 --2- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc214134460 0x7fc2141492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 -- 172.21.15.31:0/2860409954 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20800b180 con 0x7fc214063aa0 2024-04-26T07:29:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc21259c700 1 --2- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc214136240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc214138450 tx=0x7fc204007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2037fe700 1 -- 172.21.15.31:0/2860409954 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20400cdf0 con 0x7fc214063aa0 2024-04-26T07:29:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2037fe700 1 -- 172.21.15.31:0/2860409954 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2040070d0 con 0x7fc214063aa0 2024-04-26T07:29:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c009470 con 0x7fc214063aa0 2024-04-26T07:29:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.795+0000 7fc2037fe700 1 -- 172.21.15.31:0/2860409954 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc204007430 con 0x7fc214063aa0 2024-04-26T07:29:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.796+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc214136730 con 0x7fc214063aa0 2024-04-26T07:29:44.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.796+0000 7fc2037fe700 1 -- 172.21.15.31:0/2860409954 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc204010070 con 0x7fc214063aa0 2024-04-26T07:29:44.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.797+0000 7fc2037fe700 1 -- 172.21.15.31:0/2860409954 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc204049e50 con 0x7fc214063aa0 2024-04-26T07:29:44.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.797+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc214133f10 con 0x7fc214063aa0 2024-04-26T07:29:44.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.800+0000 7fc2037fe700 1 -- 172.21.15.31:0/2860409954 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc20402ed50 con 0x7fc214063aa0 2024-04-26T07:29:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.918+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc21406bbc0 con 0x7fc214063aa0 2024-04-26T07:29:44.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.918+0000 7fc2037fe700 1 -- 172.21.15.31:0/2860409954 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7fc204021070 con 0x7fc214063aa0 2024-04-26T07:29:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:44.919 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:45.886508+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:29:44.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 >> v1:172.21.15.31:6816/39613 conn(0x7fc1f0038da0 legacy=0x7fc1f003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 msgr2=0x7fc214136240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 --2- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc214136240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc214138450 tx=0x7fc204007c90).stop 2024-04-26T07:29:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 shutdown_connections 2024-04-26T07:29:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 --2- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc214063aa0 0x7fc214136240 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 --2- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc214134460 0x7fc2141492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 --2- 172.21.15.31:0/2860409954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc214065280 0x7fc214148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 >> 172.21.15.31:0/2860409954 conn(0x7fc21405cfb0 msgr2=0x7fc21406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 shutdown_connections 2024-04-26T07:29:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:44.920+0000 7fc2189bf700 1 -- 172.21.15.31:0/2860409954 wait complete. 2024-04-26T07:29:44.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T07:28:28.939656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T07:28:30.129744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T07:29:44.931 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:29:45.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.040+0000 7f5b7190b700 1 Processor -- start 2024-04-26T07:29:45.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.040+0000 7f5b7190b700 1 -- start start 2024-04-26T07:29:45.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b7190b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0a3170 0x7f5b6c09e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b7190b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5b6c09f420 0x7f5b6c0a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b7190b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c09e2a0 con 0x7f5b6c09c9e0 2024-04-26T07:29:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b7190b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6c09ce70 con 0x7f5b6c09f420 2024-04-26T07:29:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b7190b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c09d110 con 0x7f5b6c0a3170 2024-04-26T07:29:45.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0a3170 0x7f5b6c09e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b6b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5b6c09f420 0x7f5b6c0a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b6a7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5b6c09c9e0 0x7f5b6c0a3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59428/0 (socket says 172.21.15.31:59428) 2024-04-26T07:29:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b6a7fc700 1 -- 172.21.15.31:0/1996290764 learned_addr learned my addr 172.21.15.31:0/1996290764 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b6b7fe700 1 -- 172.21.15.31:0/1996290764 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0a3170 msgr2=0x7f5b6c09e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b6b7fe700 1 --2- 172.21.15.31:0/1996290764 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0a3170 0x7f5b6c09e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b6b7fe700 1 -- 172.21.15.31:0/1996290764 >> v1:172.21.15.31:6789/0 conn(0x7f5b6c09c9e0 legacy=0x7f5b6c0a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b6b7fe700 1 -- 172.21.15.31:0/1996290764 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c05c4e0 con 0x7f5b6c09f420 2024-04-26T07:29:45.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.041+0000 7f5b69ffb700 1 -- 172.21.15.31:0/1996290764 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391366967 0 0) 0x7f5b6c09e2a0 con 0x7f5b6c09c9e0 2024-04-26T07:29:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b6b7fe700 1 --2- 172.21.15.31:0/1996290764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c0a3c60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5b640032f0 tx=0x7f5b6400b470).ready entity=mon.0 client_cookie=dd4c329475ec0fe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b69ffb700 1 -- 172.21.15.31:0/1996290764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6400dd70 con 0x7f5b6c09f420 2024-04-26T07:29:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b69ffb700 1 -- 172.21.15.31:0/1996290764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b64010470 con 0x7f5b6c09f420 2024-04-26T07:29:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b69ffb700 1 -- 172.21.15.31:0/1996290764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b640107d0 con 0x7f5b6c09f420 2024-04-26T07:29:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b7190b700 1 -- 172.21.15.31:0/1996290764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 msgr2=0x7f5b6c0a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b7190b700 1 --2- 172.21.15.31:0/1996290764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c0a3c60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5b640032f0 tx=0x7f5b6400b470).stop 2024-04-26T07:29:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b7190b700 1 -- 172.21.15.31:0/1996290764 shutdown_connections 2024-04-26T07:29:45.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b7190b700 1 --2- 172.21.15.31:0/1996290764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c0a3c60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b7190b700 1 --2- 172.21.15.31:0/1996290764 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0a3170 0x7f5b6c09e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b7190b700 1 -- 172.21.15.31:0/1996290764 >> 172.21.15.31:0/1996290764 conn(0x7f5b6c060ee0 msgr2=0x7f5b6c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b7190b700 1 -- 172.21.15.31:0/1996290764 shutdown_connections 2024-04-26T07:29:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.042+0000 7f5b7190b700 1 -- 172.21.15.31:0/1996290764 wait complete. 2024-04-26T07:29:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.043+0000 7f5b7190b700 1 Processor -- start 2024-04-26T07:29:45.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.043+0000 7f5b7190b700 1 -- start start 2024-04-26T07:29:45.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b7190b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c096860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b7190b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b6c0a3170 0x7f5b6c091f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b7190b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0940c0 0x7f5b6c092400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b7190b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c096ff0 con 0x7f5b6c09f420 2024-04-26T07:29:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b7190b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c095ca0 con 0x7f5b6c0a3170 2024-04-26T07:29:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b7190b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c094550 con 0x7f5b6c0940c0 2024-04-26T07:29:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0940c0 0x7f5b6c092400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c096860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0940c0 0x7f5b6c092400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54166/0 (socket says 172.21.15.31:54166) 2024-04-26T07:29:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 -- 172.21.15.31:0/1456719803 learned_addr learned my addr 172.21.15.31:0/1456719803 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c096860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54124/0 (socket says 172.21.15.31:54124) 2024-04-26T07:29:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6a7fc700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b6c0a3170 0x7f5b6c091f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 -- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b6c0a3170 msgr2=0x7f5b6c091f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b6c0a3170 0x7f5b6c091f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 -- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 msgr2=0x7f5b6c096860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c096860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 -- 172.21.15.31:0/1456719803 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6400b710 con 0x7f5b6c0940c0 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6affd700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c096860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6a7fc700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b6c0a3170 0x7f5b6c091f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.044+0000 7f5b6b7fe700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0940c0 0x7f5b6c092400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5b640032f0 tx=0x7f5b6c0677f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.045+0000 7f5b63fff700 1 -- 172.21.15.31:0/1456719803 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b6401d070 con 0x7f5b6c0940c0 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.045+0000 7f5b63fff700 1 -- 172.21.15.31:0/1456719803 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b64018800 con 0x7f5b6c0940c0 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.045+0000 7f5b63fff700 1 -- 172.21.15.31:0/1456719803 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b64018b60 con 0x7f5b6c0940c0 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.045+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c094810 con 0x7f5b6c0940c0 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.045+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c095710 con 0x7f5b6c0940c0 2024-04-26T07:29:45.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.045+0000 7f5b63fff700 1 -- 172.21.15.31:0/1456719803 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5b64029070 con 0x7f5b6c0940c0 2024-04-26T07:29:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.045+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c067300 con 0x7f5b6c0940c0 2024-04-26T07:29:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.046+0000 7f5b63fff700 1 -- 172.21.15.31:0/1456719803 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5b6404c3d0 con 0x7f5b6c0940c0 2024-04-26T07:29:45.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.049+0000 7f5b63fff700 1 -- 172.21.15.31:0/1456719803 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5b64008200 con 0x7f5b6c0940c0 2024-04-26T07:29:45.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.165+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5b6c06bbc0 con 0x7f5b6c0940c0 2024-04-26T07:29:45.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.165+0000 7f5b63fff700 1 -- 172.21.15.31:0/1456719803 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5b64024c10 con 0x7f5b6c0940c0 2024-04-26T07:29:45.165 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:29:45.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 >> v1:172.21.15.31:6816/39613 conn(0x7f5b50038e30 legacy=0x7f5b5003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0940c0 msgr2=0x7f5b6c092400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0940c0 0x7f5b6c092400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5b640032f0 tx=0x7f5b6c0677f0).stop 2024-04-26T07:29:45.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 shutdown_connections 2024-04-26T07:29:45.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5b6c0940c0 0x7f5b6c092400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b6c09f420 0x7f5b6c096860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 --2- 172.21.15.31:0/1456719803 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5b6c0a3170 0x7f5b6c091f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 >> 172.21.15.31:0/1456719803 conn(0x7f5b6c060ee0 msgr2=0x7f5b6c09e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:45.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.166+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 shutdown_connections 2024-04-26T07:29:45.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.167+0000 7f5b7190b700 1 -- 172.21.15.31:0/1456719803 wait complete. 2024-04-26T07:29:45.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:29:45.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.286+0000 7f2bfdaa8700 1 Processor -- start 2024-04-26T07:29:45.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.286+0000 7f2bfdaa8700 1 -- start start 2024-04-26T07:29:45.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bfdaa8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2bf8137a50 0x7f2bf8137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bfdaa8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf80a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bfdaa8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bfdaa8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf80a4e20 con 0x7f2bf8137a50 2024-04-26T07:29:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bfdaa8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8137620 con 0x7f2bf80a3740 2024-04-26T07:29:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bfdaa8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8138320 con 0x7f2bf809ff30 2024-04-26T07:29:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2bf8137a50 0x7f2bf8137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf6ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf80a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf6ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf80a3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54180/0 (socket says 172.21.15.31:54180) 2024-04-26T07:29:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2bf8137a50 0x7f2bf8137e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54138/0 (socket says 172.21.15.31:54138) 2024-04-26T07:29:45.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf6ffd700 1 -- 172.21.15.31:0/596967938 learned_addr learned my addr 172.21.15.31:0/596967938 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:45.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf77fe700 1 -- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 msgr2=0x7f2bf80a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:45.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf77fe700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf80a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf77fe700 1 -- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 msgr2=0x7f2bf805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:45.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf77fe700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf805b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf77fe700 1 -- 172.21.15.31:0/596967938 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf80a46a0 con 0x7f2bf8137a50 2024-04-26T07:29:45.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf6ffd700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf80a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:45.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf7fff700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf805b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf77fe700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 0x7f2bf8137e30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f2be0002f70 tx=0x7f2be0006df0).ready entity=mon.0 client_cookie=57b393d13e8e4f9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.287+0000 7f2bf67fc700 1 -- 172.21.15.31:0/596967938 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be000d4a0 con 0x7f2bf8137a50 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bf67fc700 1 -- 172.21.15.31:0/596967938 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be0000e90 con 0x7f2bf8137a50 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bf67fc700 1 -- 172.21.15.31:0/596967938 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be000d7f0 con 0x7f2bf8137a50 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 msgr2=0x7f2bf8137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 0x7f2bf8137e30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f2be0002f70 tx=0x7f2be0006df0).stop 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/596967938 shutdown_connections 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf805b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 0x7f2bf8137e30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 --2- 172.21.15.31:0/596967938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf80a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/596967938 >> 172.21.15.31:0/596967938 conn(0x7f2bf8060ee0 msgr2=0x7f2bf80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/596967938 shutdown_connections 2024-04-26T07:29:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.288+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/596967938 wait complete. 2024-04-26T07:29:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.289+0000 7f2bfdaa8700 1 Processor -- start 2024-04-26T07:29:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.289+0000 7f2bfdaa8700 1 -- start start 2024-04-26T07:29:45.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bfdaa8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf8067040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bfdaa8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf8065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bfdaa8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 0x7f2bf8143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bfdaa8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8143640 con 0x7f2bf8137a50 2024-04-26T07:29:45.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bfdaa8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8066450 con 0x7f2bf80a3740 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bfdaa8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8063d90 con 0x7f2bf809ff30 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf77fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf8067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf77fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf8067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54182/0 (socket says 172.21.15.31:54182) 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf77fe700 1 -- 172.21.15.31:0/1859245510 learned_addr learned my addr 172.21.15.31:0/1859245510 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf7fff700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 0x7f2bf8143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf6ffd700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf8065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf77fe700 1 -- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 msgr2=0x7f2bf8065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf77fe700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf8065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf77fe700 1 -- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 msgr2=0x7f2bf8143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf77fe700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 0x7f2bf8143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf77fe700 1 -- 172.21.15.31:0/1859245510 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be800b1e0 con 0x7f2bf809ff30 2024-04-26T07:29:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf6ffd700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf8065ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-26T07:29:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.290+0000 7f2bf7fff700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 0x7f2bf8143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.291+0000 7f2bf77fe700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf8067040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2bf8066db0 tx=0x7f2be0014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.291+0000 7f2bf4ff9700 1 -- 172.21.15.31:0/1859245510 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be00139f0 con 0x7f2bf809ff30 2024-04-26T07:29:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.291+0000 7f2bf4ff9700 1 -- 172.21.15.31:0/1859245510 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be0013b50 con 0x7f2bf809ff30 2024-04-26T07:29:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.291+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf0009470 con 0x7f2bf809ff30 2024-04-26T07:29:45.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.291+0000 7f2bf4ff9700 1 -- 172.21.15.31:0/1859245510 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be001e400 con 0x7f2bf809ff30 2024-04-26T07:29:45.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.291+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be000b180 con 0x7f2bf809ff30 2024-04-26T07:29:45.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.292+0000 7f2bf4ff9700 1 -- 172.21.15.31:0/1859245510 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2be0025030 con 0x7f2bf809ff30 2024-04-26T07:29:45.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.292+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf80a0350 con 0x7f2bf809ff30 2024-04-26T07:29:45.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.292+0000 7f2bf4ff9700 1 -- 172.21.15.31:0/1859245510 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2be004b6d0 con 0x7f2bf809ff30 2024-04-26T07:29:45.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.295+0000 7f2bf4ff9700 1 -- 172.21.15.31:0/1859245510 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2be001fc80 con 0x7f2bf809ff30 2024-04-26T07:29:45.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.413+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2bf806bbc0 con 0x7f2bf809ff30 2024-04-26T07:29:45.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.413+0000 7f2bf4ff9700 1 -- 172.21.15.31:0/1859245510 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2be0023030 con 0x7f2bf809ff30 2024-04-26T07:29:45.415 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:29:45.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.414+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 >> v1:172.21.15.31:6816/39613 conn(0x7f2bdc038f50 legacy=0x7f2bdc03b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.414+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 msgr2=0x7f2bf8067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.414+0000 7f2bfdaa8700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf8067040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2bf8066db0 tx=0x7f2be0014000).stop 2024-04-26T07:29:45.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.415+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 shutdown_connections 2024-04-26T07:29:45.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.415+0000 7f2bfdaa8700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2bf809ff30 0x7f2bf8067040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.415+0000 7f2bfdaa8700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bf8137a50 0x7f2bf8143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.415+0000 7f2bfdaa8700 1 --2- 172.21.15.31:0/1859245510 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2bf80a3740 0x7f2bf8065ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.415+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 >> 172.21.15.31:0/1859245510 conn(0x7f2bf8060ee0 msgr2=0x7f2bf805c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:45.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.415+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 shutdown_connections 2024-04-26T07:29:45.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.415+0000 7f2bfdaa8700 1 -- 172.21.15.31:0/1859245510 wait complete. 2024-04-26T07:29:45.425 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T07:29:45.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.535+0000 7f00d8221700 1 Processor -- start 2024-04-26T07:29:45.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.535+0000 7f00d8221700 1 -- start start 2024-04-26T07:29:45.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.535+0000 7f00d8221700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.535+0000 7f00d8221700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d0095040 0x7f00d0099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.535+0000 7f00d8221700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00d01359b0 0x7f00d0135e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.535+0000 7f00d8221700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d0094330 con 0x7f00d01359b0 2024-04-26T07:29:45.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.535+0000 7f00d8221700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0099500 con 0x7f00d0095040 2024-04-26T07:29:45.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.535+0000 7f00d8221700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00997a0 con 0x7f00d0099bd0 2024-04-26T07:29:45.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d5fbd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d57bc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d0095040 0x7f00d0099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00d01359b0 0x7f00d0135e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00d01359b0 0x7f00d0135e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54152/0 (socket says 172.21.15.31:54152) 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d5fbd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54196/0 (socket says 172.21.15.31:54196) 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 -- 172.21.15.31:0/2851403989 learned_addr learned my addr 172.21.15.31:0/2851403989 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d57bc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d0095040 0x7f00d0099fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35666/0 (socket says 172.21.15.31:35666) 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 -- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 msgr2=0x7f00d0098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 --2- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0098f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 -- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d0095040 msgr2=0x7f00d0099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 --2- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d0095040 0x7f00d0099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 -- 172.21.15.31:0/2851403989 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d009a4a0 con 0x7f00d01359b0 2024-04-26T07:29:45.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d57bc700 1 --2- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d0095040 0x7f00d0099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:45.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d67be700 1 --2- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d01359b0 0x7f00d0135e60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f00d00996c0 tx=0x7f00c8009290).ready entity=mon.0 client_cookie=e53d8273bd8c8d2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:45.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d4fbb700 1 -- 172.21.15.31:0/2851403989 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c800b6b0 con 0x7f00d01359b0 2024-04-26T07:29:45.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d4fbb700 1 -- 172.21.15.31:0/2851403989 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c800b810 con 0x7f00d01359b0 2024-04-26T07:29:45.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.536+0000 7f00d4fbb700 1 -- 172.21.15.31:0/2851403989 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c800b980 con 0x7f00d01359b0 2024-04-26T07:29:45.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 -- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d01359b0 msgr2=0x7f00d0135e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 --2- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d01359b0 0x7f00d0135e60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f00d00996c0 tx=0x7f00c8009290).stop 2024-04-26T07:29:45.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 -- 172.21.15.31:0/2851403989 shutdown_connections 2024-04-26T07:29:45.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 --2- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d01359b0 0x7f00d0135e60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 --2- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0098f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 --2- 172.21.15.31:0/2851403989 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d0095040 0x7f00d0099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 -- 172.21.15.31:0/2851403989 >> 172.21.15.31:0/2851403989 conn(0x7f00d006c0c0 msgr2=0x7f00d006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:45.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 -- 172.21.15.31:0/2851403989 shutdown_connections 2024-04-26T07:29:45.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.537+0000 7f00d8221700 1 -- 172.21.15.31:0/2851403989 wait complete. 2024-04-26T07:29:45.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d8221700 1 Processor -- start 2024-04-26T07:29:45.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d8221700 1 -- start start 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d8221700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d0095040 0x7f00d0064c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d8221700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d8221700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d01359b0 0x7f00d0061ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d8221700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0145af0 con 0x7f00d0095040 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d8221700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00658c0 con 0x7f00d01359b0 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d8221700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0065130 con 0x7f00d0099bd0 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d5fbd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d0095040 0x7f00d0064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d67be700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d01359b0 0x7f00d0061ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d5fbd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d0095040 0x7f00d0064c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54164/0 (socket says 172.21.15.31:54164) 2024-04-26T07:29:45.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d5fbd700 1 -- 172.21.15.31:0/3231725469 learned_addr learned my addr 172.21.15.31:0/3231725469 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:45.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.538+0000 7f00d57bc700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d5fbd700 1 -- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 msgr2=0x7f00d0065dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d5fbd700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0065dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d5fbd700 1 -- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d01359b0 msgr2=0x7f00d0061ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d5fbd700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d01359b0 0x7f00d0061ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d5fbd700 1 -- 172.21.15.31:0/3231725469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c000b180 con 0x7f00d0095040 2024-04-26T07:29:45.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d67be700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d01359b0 0x7f00d0061ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:45.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d5fbd700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d0095040 0x7f00d0064c40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f00cc00c000 tx=0x7f00cc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:45.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00beffd700 1 -- 172.21.15.31:0/3231725469 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00cc0159d0 con 0x7f00d0095040 2024-04-26T07:29:45.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00beffd700 1 -- 172.21.15.31:0/3231725469 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc015b30 con 0x7f00d0095040 2024-04-26T07:29:45.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c8009530 con 0x7f00d0095040 2024-04-26T07:29:45.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00beffd700 1 -- 172.21.15.31:0/3231725469 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00cc015e90 con 0x7f00d0095040 2024-04-26T07:29:45.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.539+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d0145250 con 0x7f00d0095040 2024-04-26T07:29:45.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.540+0000 7f00beffd700 1 -- 172.21.15.31:0/3231725469 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f00cc026070 con 0x7f00d0095040 2024-04-26T07:29:45.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.540+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d006bbc0 con 0x7f00d0095040 2024-04-26T07:29:45.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.541+0000 7f00beffd700 1 -- 172.21.15.31:0/3231725469 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f00cc052910 con 0x7f00d0095040 2024-04-26T07:29:45.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.544+0000 7f00beffd700 1 -- 172.21.15.31:0/3231725469 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f00cc037810 con 0x7f00d0095040 2024-04-26T07:29:45.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.660+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00d00977e0 con 0x7f00d0095040 2024-04-26T07:29:45.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.660+0000 7f00beffd700 1 -- 172.21.15.31:0/3231725469 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00cc03ae30 con 0x7f00d0095040 2024-04-26T07:29:45.661 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-26T07:29:45.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 >> v1:172.21.15.31:6816/39613 conn(0x7f00b0038da0 legacy=0x7f00b003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d0095040 msgr2=0x7f00d0064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d0095040 0x7f00d0064c40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f00cc00c000 tx=0x7f00cc006df0).stop 2024-04-26T07:29:45.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 shutdown_connections 2024-04-26T07:29:45.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f00d01359b0 0x7f00d0061ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00d0095040 0x7f00d0064c40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 --2- 172.21.15.31:0/3231725469 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f00d0099bd0 0x7f00d0065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 >> 172.21.15.31:0/3231725469 conn(0x7f00d006c0c0 msgr2=0x7f00d0098c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:45.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 shutdown_connections 2024-04-26T07:29:45.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.661+0000 7f00d8221700 1 -- 172.21.15.31:0/3231725469 wait complete. 2024-04-26T07:29:45.672 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T07:29:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.780+0000 7f4ba687f700 1 Processor -- start 2024-04-26T07:29:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4ba687f700 1 -- start start 2024-04-26T07:29:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4ba687f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba006c7d0 0x7f4ba01360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4ba687f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ba0096320 0x7f4ba005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4ba687f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba00970a0 con 0x7f4ba005be60 2024-04-26T07:29:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4ba687f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba0133c10 con 0x7f4ba0096320 2024-04-26T07:29:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4ba687f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0136780 con 0x7f4ba006c7d0 2024-04-26T07:29:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4b9ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba006c7d0 0x7f4ba01360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4b9f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ba0096320 0x7f4ba005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4ba4e1c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4ba005be60 0x7f4ba0140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59436/0 (socket says 172.21.15.31:59436) 2024-04-26T07:29:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4b9f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ba0096320 0x7f4ba005b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54174/0 (socket says 172.21.15.31:54174) 2024-04-26T07:29:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4b9ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba006c7d0 0x7f4ba01360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35692/0 (socket says 172.21.15.31:35692) 2024-04-26T07:29:45.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.781+0000 7f4ba4e1c700 1 -- 172.21.15.31:0/739636806 learned_addr learned my addr 172.21.15.31:0/739636806 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:45.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9ffff700 1 -- 172.21.15.31:0/739636806 >> v2:172.21.15.31:3300/0 conn(0x7f4ba0096320 msgr2=0x7f4ba005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:45.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9ffff700 1 --2- 172.21.15.31:0/739636806 >> v2:172.21.15.31:3300/0 conn(0x7f4ba0096320 0x7f4ba005b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9ffff700 1 -- 172.21.15.31:0/739636806 >> v1:172.21.15.31:6789/0 conn(0x7f4ba005be60 legacy=0x7f4ba0140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9ffff700 1 -- 172.21.15.31:0/739636806 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba0136a40 con 0x7f4ba006c7d0 2024-04-26T07:29:45.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9f7fe700 1 --2- 172.21.15.31:0/739636806 >> v2:172.21.15.31:3300/0 conn(0x7f4ba0096320 0x7f4ba005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:45.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9ffff700 1 --2- 172.21.15.31:0/739636806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba006c7d0 0x7f4ba01360f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4b90002f70 tx=0x7f4b90006df0).ready entity=mon.1 client_cookie=917b16670a0d8f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9effd700 1 -- 172.21.15.31:0/739636806 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b9000d570 con 0x7f4ba006c7d0 2024-04-26T07:29:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9effd700 1 -- 172.21.15.31:0/739636806 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b90000e90 con 0x7f4ba006c7d0 2024-04-26T07:29:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4b9effd700 1 -- 172.21.15.31:0/739636806 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b9000d8c0 con 0x7f4ba006c7d0 2024-04-26T07:29:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4ba687f700 1 -- 172.21.15.31:0/739636806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba006c7d0 msgr2=0x7f4ba01360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4ba687f700 1 --2- 172.21.15.31:0/739636806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba006c7d0 0x7f4ba01360f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4b90002f70 tx=0x7f4b90006df0).stop 2024-04-26T07:29:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4ba687f700 1 -- 172.21.15.31:0/739636806 shutdown_connections 2024-04-26T07:29:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4ba687f700 1 --2- 172.21.15.31:0/739636806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba006c7d0 0x7f4ba01360f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4ba687f700 1 --2- 172.21.15.31:0/739636806 >> v2:172.21.15.31:3300/0 conn(0x7f4ba0096320 0x7f4ba005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.782+0000 7f4ba687f700 1 -- 172.21.15.31:0/739636806 >> 172.21.15.31:0/739636806 conn(0x7f4ba0061370 msgr2=0x7f4ba006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.783+0000 7f4ba687f700 1 -- 172.21.15.31:0/739636806 shutdown_connections 2024-04-26T07:29:45.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.783+0000 7f4ba687f700 1 -- 172.21.15.31:0/739636806 wait complete. 2024-04-26T07:29:45.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.783+0000 7f4ba687f700 1 Processor -- start 2024-04-26T07:29:45.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.783+0000 7f4ba687f700 1 -- start start 2024-04-26T07:29:45.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4ba687f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba005be60 0x7f4ba009d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4ba687f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba006c7d0 0x7f4ba0067b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4ba687f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ba0096320 0x7f4ba0149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:45.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4ba687f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba009d3b0 con 0x7f4ba006c7d0 2024-04-26T07:29:45.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4ba687f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba01496a0 con 0x7f4ba005be60 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4ba687f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba009dd30 con 0x7f4ba0096320 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4b9ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba005be60 0x7f4ba009d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4b9f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba006c7d0 0x7f4ba0067b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4b9ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba005be60 0x7f4ba009d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35708/0 (socket says 172.21.15.31:35708) 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4b9ffff700 1 -- 172.21.15.31:0/3326198910 learned_addr learned my addr 172.21.15.31:0/3326198910 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.784+0000 7f4ba4e1c700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ba0096320 0x7f4ba0149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9ffff700 1 -- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ba0096320 msgr2=0x7f4ba0149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9ffff700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ba0096320 0x7f4ba0149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9ffff700 1 -- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba006c7d0 msgr2=0x7f4ba0067b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9ffff700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba006c7d0 0x7f4ba0067b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9ffff700 1 -- 172.21.15.31:0/3326198910 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9400b180 con 0x7f4ba005be60 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9f7fe700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba006c7d0 0x7f4ba0067b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9ffff700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba005be60 0x7f4ba009d840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4b90002f70 tx=0x7f4b90014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9d7fa700 1 -- 172.21.15.31:0/3326198910 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b90013de0 con 0x7f4ba005be60 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9d7fa700 1 -- 172.21.15.31:0/3326198910 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9001e400 con 0x7f4ba005be60 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4b9d7fa700 1 -- 172.21.15.31:0/3326198910 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b9001e760 con 0x7f4ba005be60 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9000b180 con 0x7f4ba005be60 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.785+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba0065c40 con 0x7f4ba005be60 2024-04-26T07:29:45.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.786+0000 7f4b9d7fa700 1 -- 172.21.15.31:0/3326198910 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4b90025030 con 0x7f4ba005be60 2024-04-26T07:29:45.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.786+0000 7f4b9d7fa700 1 -- 172.21.15.31:0/3326198910 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4b9004b6b0 con 0x7f4ba005be60 2024-04-26T07:29:45.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.786+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba0068240 con 0x7f4ba005be60 2024-04-26T07:29:45.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.789+0000 7f4b9d7fa700 1 -- 172.21.15.31:0/3326198910 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4b90023030 con 0x7f4ba005be60 2024-04-26T07:29:45.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.907+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ba00975a0 con 0x7f4ba005be60 2024-04-26T07:29:45.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.908+0000 7f4b9d7fa700 1 -- 172.21.15.31:0/3326198910 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b90028820 con 0x7f4ba005be60 2024-04-26T07:29:45.908 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-26T07:29:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 >> v1:172.21.15.31:6816/39613 conn(0x7f4b80038e60 legacy=0x7f4b8003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba005be60 msgr2=0x7f4ba009d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba005be60 0x7f4ba009d840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4b90002f70 tx=0x7f4b90014000).stop 2024-04-26T07:29:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 shutdown_connections 2024-04-26T07:29:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ba0096320 0x7f4ba0149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ba005be60 0x7f4ba009d840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 --2- 172.21.15.31:0/3326198910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ba006c7d0 0x7f4ba0067b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 >> 172.21.15.31:0/3326198910 conn(0x7f4ba0061370 msgr2=0x7f4ba00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 shutdown_connections 2024-04-26T07:29:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:45.909+0000 7f4ba687f700 1 -- 172.21.15.31:0/3326198910 wait complete. 2024-04-26T07:29:45.920 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T07:29:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.027+0000 7f2db1bd8700 1 Processor -- start 2024-04-26T07:29:46.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.027+0000 7f2db1bd8700 1 -- start start 2024-04-26T07:29:46.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2db1bd8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac1379f0 0x7f2dac09ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2db1bd8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2dac1381b0 0x7f2dac13e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2db1bd8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac09c4f0 con 0x7f2dac137dd0 2024-04-26T07:29:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2db1bd8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac0a4d20 con 0x7f2dac1381b0 2024-04-26T07:29:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2db1bd8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0a3b40 con 0x7f2dac1379f0 2024-04-26T07:29:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2dab7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac1379f0 0x7f2dac09ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2dabfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2dac1381b0 0x7f2dac13e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2dab7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac1379f0 0x7f2dac09ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35722/0 (socket says 172.21.15.31:35722) 2024-04-26T07:29:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2dab7fe700 1 -- 172.21.15.31:0/2561699376 learned_addr learned my addr 172.21.15.31:0/2561699376 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2dabfff700 1 -- 172.21.15.31:0/2561699376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac1379f0 msgr2=0x7f2dac09ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.028+0000 7f2dabfff700 1 --2- 172.21.15.31:0/2561699376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac1379f0 0x7f2dac09ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2dabfff700 1 -- 172.21.15.31:0/2561699376 >> v1:172.21.15.31:6789/0 conn(0x7f2dac137dd0 legacy=0x7f2dac0a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2dabfff700 1 -- 172.21.15.31:0/2561699376 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac1375c0 con 0x7f2dac1381b0 2024-04-26T07:29:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2daa7fc700 1 -- 172.21.15.31:0/2561699376 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546466230 0 0) 0x7f2dac09c4f0 con 0x7f2dac137dd0 2024-04-26T07:29:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2dab7fe700 1 --2- 172.21.15.31:0/2561699376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac1379f0 0x7f2dac09ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:46.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2dabfff700 1 --2- 172.21.15.31:0/2561699376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dac1381b0 0x7f2dac13e860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f2da40032f0 tx=0x7f2da40091d0).ready entity=mon.0 client_cookie=d91f2e9237dbdd0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:46.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2daa7fc700 1 -- 172.21.15.31:0/2561699376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da400b6c0 con 0x7f2dac1381b0 2024-04-26T07:29:46.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2daa7fc700 1 -- 172.21.15.31:0/2561699376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400b820 con 0x7f2dac1381b0 2024-04-26T07:29:46.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2daa7fc700 1 -- 172.21.15.31:0/2561699376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da400b990 con 0x7f2dac1381b0 2024-04-26T07:29:46.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2db1bd8700 1 -- 172.21.15.31:0/2561699376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dac1381b0 msgr2=0x7f2dac13e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2db1bd8700 1 --2- 172.21.15.31:0/2561699376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dac1381b0 0x7f2dac13e860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f2da40032f0 tx=0x7f2da40091d0).stop 2024-04-26T07:29:46.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2db1bd8700 1 -- 172.21.15.31:0/2561699376 shutdown_connections 2024-04-26T07:29:46.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2db1bd8700 1 --2- 172.21.15.31:0/2561699376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dac1381b0 0x7f2dac13e860 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2db1bd8700 1 --2- 172.21.15.31:0/2561699376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac1379f0 0x7f2dac09ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2db1bd8700 1 -- 172.21.15.31:0/2561699376 >> 172.21.15.31:0/2561699376 conn(0x7f2dac060ee0 msgr2=0x7f2dac0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:46.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2db1bd8700 1 -- 172.21.15.31:0/2561699376 shutdown_connections 2024-04-26T07:29:46.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.029+0000 7f2db1bd8700 1 -- 172.21.15.31:0/2561699376 wait complete. 2024-04-26T07:29:46.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.030+0000 7f2db1bd8700 1 Processor -- start 2024-04-26T07:29:46.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.030+0000 7f2db1bd8700 1 -- start start 2024-04-26T07:29:46.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2db1bd8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2dac1379f0 0x7f2dac09d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2db1bd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dac137dd0 0x7f2dac148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2db1bd8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac0675e0 0x7f2dac149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2db1bd8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac09e240 con 0x7f2dac137dd0 2024-04-26T07:29:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2db1bd8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac09e520 con 0x7f2dac0675e0 2024-04-26T07:29:46.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2db1bd8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0923c0 con 0x7f2dac1379f0 2024-04-26T07:29:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2dabfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac0675e0 0x7f2dac149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2daaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dac137dd0 0x7f2dac148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2dabfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac0675e0 0x7f2dac149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35732/0 (socket says 172.21.15.31:35732) 2024-04-26T07:29:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2daaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dac137dd0 0x7f2dac148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54202/0 (socket says 172.21.15.31:54202) 2024-04-26T07:29:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2dabfff700 1 -- 172.21.15.31:0/648608143 learned_addr learned my addr 172.21.15.31:0/648608143 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2dab7fe700 1 --2- 172.21.15.31:0/648608143 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2dac1379f0 0x7f2dac09d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2daaffd700 1 -- 172.21.15.31:0/648608143 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2dac1379f0 msgr2=0x7f2dac09d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2daaffd700 1 --2- 172.21.15.31:0/648608143 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2dac1379f0 0x7f2dac09d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2daaffd700 1 -- 172.21.15.31:0/648608143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac0675e0 msgr2=0x7f2dac149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2daaffd700 1 --2- 172.21.15.31:0/648608143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac0675e0 0x7f2dac149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2daaffd700 1 -- 172.21.15.31:0/648608143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c00b1e0 con 0x7f2dac137dd0 2024-04-26T07:29:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2dabfff700 1 --2- 172.21.15.31:0/648608143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2dac0675e0 0x7f2dac149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.031+0000 7f2daaffd700 1 --2- 172.21.15.31:0/648608143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dac137dd0 0x7f2dac148c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f2da0000bc0 tx=0x7f2da00079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.032+0000 7f2da8ff9700 1 -- 172.21.15.31:0/648608143 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da000ce80 con 0x7f2dac137dd0 2024-04-26T07:29:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.032+0000 7f2da8ff9700 1 -- 172.21.15.31:0/648608143 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0012400 con 0x7f2dac137dd0 2024-04-26T07:29:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.032+0000 7f2da8ff9700 1 -- 172.21.15.31:0/648608143 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da0012760 con 0x7f2dac137dd0 2024-04-26T07:29:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.032+0000 7f2db1bd8700 1 -- 172.21.15.31:0/648608143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da4009470 con 0x7f2dac137dd0 2024-04-26T07:29:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.032+0000 7f2db1bd8700 1 -- 172.21.15.31:0/648608143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac13a890 con 0x7f2dac137dd0 2024-04-26T07:29:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.032+0000 7f2da8ff9700 1 -- 172.21.15.31:0/648608143 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2da0019030 con 0x7f2dac137dd0 2024-04-26T07:29:46.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.033+0000 7f2da8ff9700 1 -- 172.21.15.31:0/648608143 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2da0049d80 con 0x7f2dac137dd0 2024-04-26T07:29:46.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.033+0000 7f2db1bd8700 1 -- 172.21.15.31:0/648608143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac0a3880 con 0x7f2dac137dd0 2024-04-26T07:29:46.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.036+0000 7f2da8ff9700 1 -- 172.21.15.31:0/648608143 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2da002eb70 con 0x7f2dac137dd0 2024-04-26T07:29:46.196 INFO:teuthology.orchestra.run.smithi031.stderr:no valid command found; 10 closest matches: 2024-04-26T07:29:46.197 INFO:teuthology.orchestra.run.smithi031.stderr:osd perf 2024-04-26T07:29:46.197 INFO:teuthology.orchestra.run.smithi031.stderr:osd df [plain|tree] [class|name] [] 2024-04-26T07:29:46.197 INFO:teuthology.orchestra.run.smithi031.stderr:osd blocked-by 2024-04-26T07:29:46.197 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool stats [] 2024-04-26T07:29:46.197 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool scrub ... 2024-04-26T07:29:46.197 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool deep-scrub ... 2024-04-26T07:29:46.197 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool repair ... 2024-04-26T07:29:46.198 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool force-recovery ... 2024-04-26T07:29:46.198 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool force-backfill ... 2024-04-26T07:29:46.198 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool cancel-force-recovery ... 2024-04-26T07:29:46.198 INFO:teuthology.orchestra.run.smithi031.stderr:Error EINVAL: invalid command 2024-04-26T07:29:46.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T07:29:46.200 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-04-26T07:29:46.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f508dc38700 1 Processor -- start 2024-04-26T07:29:46.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f508dc38700 1 -- start start 2024-04-26T07:29:46.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f508dc38700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50880a3170 0x7f508809e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f508dc38700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f508809f420 0x7f50880a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f508dc38700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508809e2a0 con 0x7f508809c9e0 2024-04-26T07:29:46.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f508dc38700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508809ce70 con 0x7f508809f420 2024-04-26T07:29:46.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f508dc38700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508809d110 con 0x7f50880a3170 2024-04-26T07:29:46.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f5087fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f508809f420 0x7f50880a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f5086ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f508809c9e0 0x7f50880a3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59462/0 (socket says 172.21.15.31:59462) 2024-04-26T07:29:46.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f5086ffd700 1 -- 172.21.15.31:0/1572931176 learned_addr learned my addr 172.21.15.31:0/1572931176 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:46.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.307+0000 7f50877fe700 1 --2- 172.21.15.31:0/1572931176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50880a3170 0x7f508809e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f50877fe700 1 -- 172.21.15.31:0/1572931176 >> v2:172.21.15.31:3300/0 conn(0x7f508809f420 msgr2=0x7f50880a3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f50877fe700 1 --2- 172.21.15.31:0/1572931176 >> v2:172.21.15.31:3300/0 conn(0x7f508809f420 0x7f50880a3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f50877fe700 1 -- 172.21.15.31:0/1572931176 >> v1:172.21.15.31:6789/0 conn(0x7f508809c9e0 legacy=0x7f50880a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f50877fe700 1 -- 172.21.15.31:0/1572931176 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508805c4e0 con 0x7f50880a3170 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f5087fff700 1 --2- 172.21.15.31:0/1572931176 >> v2:172.21.15.31:3300/0 conn(0x7f508809f420 0x7f50880a3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f50877fe700 1 --2- 172.21.15.31:0/1572931176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50880a3170 0x7f508809e6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5078002f70 tx=0x7f5078006df0).ready entity=mon.1 client_cookie=afb01b82e6febe45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f50867fc700 1 -- 172.21.15.31:0/1572931176 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f507800d570 con 0x7f50880a3170 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f50867fc700 1 -- 172.21.15.31:0/1572931176 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5078000e90 con 0x7f50880a3170 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f50867fc700 1 -- 172.21.15.31:0/1572931176 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f507800d8c0 con 0x7f50880a3170 2024-04-26T07:29:46.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f508dc38700 1 -- 172.21.15.31:0/1572931176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50880a3170 msgr2=0x7f508809e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.308+0000 7f508dc38700 1 --2- 172.21.15.31:0/1572931176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50880a3170 0x7f508809e6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5078002f70 tx=0x7f5078006df0).stop 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.309+0000 7f508dc38700 1 -- 172.21.15.31:0/1572931176 shutdown_connections 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.309+0000 7f508dc38700 1 --2- 172.21.15.31:0/1572931176 >> v2:172.21.15.31:3300/0 conn(0x7f508809f420 0x7f50880a3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.309+0000 7f508dc38700 1 --2- 172.21.15.31:0/1572931176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50880a3170 0x7f508809e6f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.309+0000 7f508dc38700 1 -- 172.21.15.31:0/1572931176 >> 172.21.15.31:0/1572931176 conn(0x7f5088060ee0 msgr2=0x7f50880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.309+0000 7f508dc38700 1 -- 172.21.15.31:0/1572931176 shutdown_connections 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.309+0000 7f508dc38700 1 -- 172.21.15.31:0/1572931176 wait complete. 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.309+0000 7f508dc38700 1 Processor -- start 2024-04-26T07:29:46.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f508dc38700 1 -- start start 2024-04-26T07:29:46.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f508dc38700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508809f420 0x7f5088092e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f508dc38700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f50880a3170 0x7f5088065ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f508dc38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5088066090 0x7f5088066520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f508dc38700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50880940f0 con 0x7f5088066090 2024-04-26T07:29:46.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f508dc38700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5088066a10 con 0x7f508809f420 2024-04-26T07:29:46.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f508dc38700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5088093bf0 con 0x7f50880a3170 2024-04-26T07:29:46.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f5086ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f50880a3170 0x7f5088065ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f5087fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5088066090 0x7f5088066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f50877fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508809f420 0x7f5088092e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f5086ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f50880a3170 0x7f5088065ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54232/0 (socket says 172.21.15.31:54232) 2024-04-26T07:29:46.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.310+0000 7f5086ffd700 1 -- 172.21.15.31:0/3121620909 learned_addr learned my addr 172.21.15.31:0/3121620909 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:46.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f50877fe700 1 -- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f50880a3170 msgr2=0x7f5088065ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f50877fe700 1 --2- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f50880a3170 0x7f5088065ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f50877fe700 1 -- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5088066090 msgr2=0x7f5088066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f50877fe700 1 --2- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5088066090 0x7f5088066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f50877fe700 1 -- 172.21.15.31:0/3121620909 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080009470 con 0x7f508809f420 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f5087fff700 1 --2- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5088066090 0x7f5088066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f50877fe700 1 --2- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508809f420 0x7f5088092e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5078002f70 tx=0x7f5078014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f5084ff9700 1 -- 172.21.15.31:0/3121620909 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5078013de0 con 0x7f508809f420 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f5084ff9700 1 -- 172.21.15.31:0/3121620909 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507801e400 con 0x7f508809f420 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f5084ff9700 1 -- 172.21.15.31:0/3121620909 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f507801e760 con 0x7f508809f420 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507800b180 con 0x7f508809f420 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.311+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50880945e0 con 0x7f508809f420 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.312+0000 7f5084ff9700 1 -- 172.21.15.31:0/3121620909 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f507801c070 con 0x7f508809f420 2024-04-26T07:29:46.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.312+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508806bbc0 con 0x7f508809f420 2024-04-26T07:29:46.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.312+0000 7f5084ff9700 1 -- 172.21.15.31:0/3121620909 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f507804b280 con 0x7f508809f420 2024-04-26T07:29:46.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.315+0000 7f5084ff9700 1 -- 172.21.15.31:0/3121620909 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5078006320 con 0x7f508809f420 2024-04-26T07:29:46.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.447+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) v1 -- 0x7f50880a0930 con 0x7f508809f420 2024-04-26T07:29:46.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.448+0000 7f5084ff9700 1 -- 172.21.15.31:0/3121620909 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v19) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5078019070 con 0x7f508809f420 2024-04-26T07:29:46.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 >> v1:172.21.15.31:6816/39613 conn(0x7f5068038f80 legacy=0x7f506803b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508809f420 msgr2=0x7f5088092e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 --2- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508809f420 0x7f5088092e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5078002f70 tx=0x7f5078014000).stop 2024-04-26T07:29:46.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 shutdown_connections 2024-04-26T07:29:46.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 --2- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5088066090 0x7f5088066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 --2- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508809f420 0x7f5088092e10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 --2- 172.21.15.31:0/3121620909 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f50880a3170 0x7f5088065ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 >> 172.21.15.31:0/3121620909 conn(0x7f5088060ee0 msgr2=0x7f508809e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:46.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 shutdown_connections 2024-04-26T07:29:46.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.449+0000 7f508dc38700 1 -- 172.21.15.31:0/3121620909 wait complete. 2024-04-26T07:29:46.451 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-04-26T07:29:46.460 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-26T07:29:46.460 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T07:29:46.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:29:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.588+0000 7f9c06de0700 1 Processor -- start 2024-04-26T07:29:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c06de0700 1 -- start start 2024-04-26T07:29:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c06de0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c001360f0 0x7f9c00096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c06de0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c06de0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c000970a0 con 0x7f9c0006c7d0 2024-04-26T07:29:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c06de0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c00133c10 con 0x7f9c001360f0 2024-04-26T07:29:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c06de0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c00136500 con 0x7f9c0005c080 2024-04-26T07:29:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c0537d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9bfffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c001360f0 0x7f9c00096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c0537d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35766/0 (socket says 172.21.15.31:35766) 2024-04-26T07:29:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c04b7c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9c0006c7d0 0x7f9c0005b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59468/0 (socket says 172.21.15.31:59468) 2024-04-26T07:29:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9c0537d700 1 -- 172.21.15.31:0/3206275411 learned_addr learned my addr 172.21.15.31:0/3206275411 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.589+0000 7f9bfffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c001360f0 0x7f9c00096320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54232/0 (socket says 172.21.15.31:54232) 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bfffff700 1 -- 172.21.15.31:0/3206275411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 msgr2=0x7f9c00141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bfffff700 1 --2- 172.21.15.31:0/3206275411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bfffff700 1 -- 172.21.15.31:0/3206275411 >> v1:172.21.15.31:6789/0 conn(0x7f9c0006c7d0 legacy=0x7f9c0005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bff7fe700 1 -- 172.21.15.31:0/3206275411 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431993070 0 0) 0x7f9c000970a0 con 0x7f9c0006c7d0 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bfffff700 1 -- 172.21.15.31:0/3206275411 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00096810 con 0x7f9c001360f0 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9c0537d700 1 --2- 172.21.15.31:0/3206275411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bfffff700 1 --2- 172.21.15.31:0/3206275411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 0x7f9c00096320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9bec002f70 tx=0x7f9bec006df0).ready entity=mon.0 client_cookie=40aff9e13fbda6fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bff7fe700 1 -- 172.21.15.31:0/3206275411 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bec00d570 con 0x7f9c001360f0 2024-04-26T07:29:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bff7fe700 1 -- 172.21.15.31:0/3206275411 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec000e90 con 0x7f9c001360f0 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9bff7fe700 1 -- 172.21.15.31:0/3206275411 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bec00d8c0 con 0x7f9c001360f0 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9c06de0700 1 -- 172.21.15.31:0/3206275411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 msgr2=0x7f9c00096320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9c06de0700 1 --2- 172.21.15.31:0/3206275411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 0x7f9c00096320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9bec002f70 tx=0x7f9bec006df0).stop 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9c06de0700 1 -- 172.21.15.31:0/3206275411 shutdown_connections 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9c06de0700 1 --2- 172.21.15.31:0/3206275411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9c06de0700 1 --2- 172.21.15.31:0/3206275411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 0x7f9c00096320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9c06de0700 1 -- 172.21.15.31:0/3206275411 >> 172.21.15.31:0/3206275411 conn(0x7f9c00061370 msgr2=0x7f9c0006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.590+0000 7f9c06de0700 1 -- 172.21.15.31:0/3206275411 shutdown_connections 2024-04-26T07:29:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.591+0000 7f9c06de0700 1 -- 172.21.15.31:0/3206275411 wait complete. 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.591+0000 7f9c06de0700 1 Processor -- start 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.591+0000 7f9c06de0700 1 -- start start 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c06de0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00066b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c06de0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9c0006c7d0 0x7f9c00149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c06de0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 0x7f9c00149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c06de0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0009da40 con 0x7f9c001360f0 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c06de0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0013a590 con 0x7f9c0005c080 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c06de0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000a6b00 con 0x7f9c0006c7d0 2024-04-26T07:29:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c04b7c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c04b7c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00066b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35772/0 (socket says 172.21.15.31:35772) 2024-04-26T07:29:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c04b7c700 1 -- 172.21.15.31:0/3083195765 learned_addr learned my addr 172.21.15.31:0/3083195765 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9bfffff700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9c0006c7d0 0x7f9c00149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9c0537d700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 0x7f9c00149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9bfffff700 1 -- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 msgr2=0x7f9c00066b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9bfffff700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00066b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9bfffff700 1 -- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 msgr2=0x7f9c00149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9bfffff700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 0x7f9c00149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.592+0000 7f9bfffff700 1 -- 172.21.15.31:0/3083195765 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf8009530 con 0x7f9c0006c7d0 2024-04-26T07:29:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.593+0000 7f9bfffff700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9c0006c7d0 0x7f9c00149240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9bec002f70 tx=0x7f9bec014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.593+0000 7f9bfdffb700 1 -- 172.21.15.31:0/3083195765 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bec016070 con 0x7f9c0006c7d0 2024-04-26T07:29:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.593+0000 7f9bfdffb700 1 -- 172.21.15.31:0/3083195765 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec0138d0 con 0x7f9c0006c7d0 2024-04-26T07:29:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.593+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec00b180 con 0x7f9c0006c7d0 2024-04-26T07:29:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.593+0000 7f9bfdffb700 1 -- 172.21.15.31:0/3083195765 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bec013c30 con 0x7f9c0006c7d0 2024-04-26T07:29:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.593+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c00066420 con 0x7f9c0006c7d0 2024-04-26T07:29:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.594+0000 7f9bfdffb700 1 -- 172.21.15.31:0/3083195765 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9bec00f030 con 0x7f9c0006c7d0 2024-04-26T07:29:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.594+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c00136780 con 0x7f9c0006c7d0 2024-04-26T07:29:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.594+0000 7f9bfdffb700 1 -- 172.21.15.31:0/3083195765 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9bec04b520 con 0x7f9c0006c7d0 2024-04-26T07:29:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.597+0000 7f9bfdffb700 1 -- 172.21.15.31:0/3083195765 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9bec0275c0 con 0x7f9c0006c7d0 2024-04-26T07:29:46.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.715+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c00097f90 con 0x7f9c0006c7d0 2024-04-26T07:29:46.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.716+0000 7f9bfdffb700 1 -- 172.21.15.31:0/3083195765 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7f9bec023020 con 0x7f9c0006c7d0 2024-04-26T07:29:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:46.717 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:45.886508+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:29:46.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.717+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 >> v1:172.21.15.31:6816/39613 conn(0x7f9be0038dd0 legacy=0x7f9be003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9c0006c7d0 msgr2=0x7f9c00149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9c0006c7d0 0x7f9c00149240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9bec002f70 tx=0x7f9bec014000).stop 2024-04-26T07:29:46.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 shutdown_connections 2024-04-26T07:29:46.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c001360f0 0x7f9c00149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c0005c080 0x7f9c00066b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 --2- 172.21.15.31:0/3083195765 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9c0006c7d0 0x7f9c00149240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 >> 172.21.15.31:0/3083195765 conn(0x7f9c00061370 msgr2=0x7f9c000a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 shutdown_connections 2024-04-26T07:29:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.718+0000 7f9c06de0700 1 -- 172.21.15.31:0/3083195765 wait complete. 2024-04-26T07:29:46.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T07:28:28.939656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T07:28:30.129744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T07:29:46.729 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:29:46.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.839+0000 7f32c9714700 1 Processor -- start 2024-04-26T07:29:46.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.839+0000 7f32c9714700 1 -- start start 2024-04-26T07:29:46.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.840+0000 7f32c9714700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c40679d0 0x7f32c41339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.840+0000 7f32c9714700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c413ea20 0x7f32c4140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.840+0000 7f32c9714700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c4133ea0 con 0x7f32c41335d0 2024-04-26T07:29:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.840+0000 7f32c9714700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40670c0 con 0x7f32c413ea20 2024-04-26T07:29:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.840+0000 7f32c9714700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4066600 con 0x7f32c40679d0 2024-04-26T07:29:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c2ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f32c41335d0 0x7f32c40a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59470/0 (socket says 172.21.15.31:59470) 2024-04-26T07:29:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c2ffd700 1 -- 172.21.15.31:0/3922801485 learned_addr learned my addr 172.21.15.31:0/3922801485 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c27fc700 1 --2- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c40679d0 0x7f32c41339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c37fe700 1 --2- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c413ea20 0x7f32c4140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c27fc700 1 -- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c413ea20 msgr2=0x7f32c4140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c27fc700 1 --2- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c413ea20 0x7f32c4140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c27fc700 1 -- 172.21.15.31:0/3922801485 >> v1:172.21.15.31:6789/0 conn(0x7f32c41335d0 legacy=0x7f32c40a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c27fc700 1 -- 172.21.15.31:0/3922801485 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c4066de0 con 0x7f32c40679d0 2024-04-26T07:29:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c37fe700 1 --2- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c413ea20 0x7f32c4140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:46.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.841+0000 7f32c27fc700 1 --2- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c40679d0 0x7f32c41339b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f32b8002f70 tx=0x7f32b8006df0).ready entity=mon.2 client_cookie=8f716a5680355f2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:46.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.842+0000 7f32c1ffb700 1 -- 172.21.15.31:0/3922801485 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32b800d570 con 0x7f32c40679d0 2024-04-26T07:29:46.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.842+0000 7f32c1ffb700 1 -- 172.21.15.31:0/3922801485 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b8000e90 con 0x7f32c40679d0 2024-04-26T07:29:46.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.842+0000 7f32c1ffb700 1 -- 172.21.15.31:0/3922801485 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32b800d8c0 con 0x7f32c40679d0 2024-04-26T07:29:46.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.843+0000 7f32c9714700 1 -- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c40679d0 msgr2=0x7f32c41339b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.843+0000 7f32c9714700 1 --2- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c40679d0 0x7f32c41339b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f32b8002f70 tx=0x7f32b8006df0).stop 2024-04-26T07:29:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.843+0000 7f32c9714700 1 -- 172.21.15.31:0/3922801485 shutdown_connections 2024-04-26T07:29:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.843+0000 7f32c9714700 1 --2- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c413ea20 0x7f32c4140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.843+0000 7f32c9714700 1 --2- 172.21.15.31:0/3922801485 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c40679d0 0x7f32c41339b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.843+0000 7f32c9714700 1 -- 172.21.15.31:0/3922801485 >> 172.21.15.31:0/3922801485 conn(0x7f32c4060ee0 msgr2=0x7f32c40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.843+0000 7f32c9714700 1 -- 172.21.15.31:0/3922801485 shutdown_connections 2024-04-26T07:29:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.843+0000 7f32c9714700 1 -- 172.21.15.31:0/3922801485 wait complete. 2024-04-26T07:29:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.844+0000 7f32c9714700 1 Processor -- start 2024-04-26T07:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.844+0000 7f32c9714700 1 -- start start 2024-04-26T07:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.844+0000 7f32c9714700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c40679d0 0x7f32c4135860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c9714700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32c41335d0 0x7f32c412c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c9714700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c413ea20 0x7f32c412c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c9714700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4135d50 con 0x7f32c41335d0 2024-04-26T07:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c9714700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c409cbf0 con 0x7f32c40679d0 2024-04-26T07:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c9714700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4135f90 con 0x7f32c413ea20 2024-04-26T07:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c40679d0 0x7f32c4135860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c413ea20 0x7f32c412c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c40679d0 0x7f32c4135860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35788/0 (socket says 172.21.15.31:35788) 2024-04-26T07:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c2ffd700 1 -- 172.21.15.31:0/1388348125 learned_addr learned my addr 172.21.15.31:0/1388348125 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c27fc700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32c41335d0 0x7f32c412c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c37fe700 1 -- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c40679d0 msgr2=0x7f32c4135860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c37fe700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c40679d0 0x7f32c4135860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c37fe700 1 -- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32c41335d0 msgr2=0x7f32c412c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c37fe700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32c41335d0 0x7f32c412c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c37fe700 1 -- 172.21.15.31:0/1388348125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc009470 con 0x7f32c413ea20 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c2ffd700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c40679d0 0x7f32c4135860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c27fc700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32c41335d0 0x7f32c412c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c37fe700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c413ea20 0x7f32c412c8f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f32bc00c000 tx=0x7f32bc0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32b3fff700 1 -- 172.21.15.31:0/1388348125 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32bc012600 con 0x7f32c413ea20 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32b3fff700 1 -- 172.21.15.31:0/1388348125 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc012760 con 0x7f32c413ea20 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b800b180 con 0x7f32c413ea20 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32b3fff700 1 -- 172.21.15.31:0/1388348125 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32bc012ac0 con 0x7f32c413ea20 2024-04-26T07:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.845+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c409da60 con 0x7f32c413ea20 2024-04-26T07:29:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.846+0000 7f32b3fff700 1 -- 172.21.15.31:0/1388348125 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f32bc022070 con 0x7f32c413ea20 2024-04-26T07:29:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.846+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c4065ba0 con 0x7f32c413ea20 2024-04-26T07:29:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.846+0000 7f32b3fff700 1 -- 172.21.15.31:0/1388348125 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f32bc04afd0 con 0x7f32c413ea20 2024-04-26T07:29:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.849+0000 7f32b3fff700 1 -- 172.21.15.31:0/1388348125 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f32bc02fe00 con 0x7f32c413ea20 2024-04-26T07:29:46.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.967+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f32c406bbc0 con 0x7f32c413ea20 2024-04-26T07:29:46.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.967+0000 7f32b3fff700 1 -- 172.21.15.31:0/1388348125 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f32bc016030 con 0x7f32c413ea20 2024-04-26T07:29:46.967 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:29:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.968+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 >> v1:172.21.15.31:6816/39613 conn(0x7f32a0038da0 legacy=0x7f32a003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.968+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c413ea20 msgr2=0x7f32c412c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.968+0000 7f32c9714700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c413ea20 0x7f32c412c8f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f32bc00c000 tx=0x7f32bc0091d0).stop 2024-04-26T07:29:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.968+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 shutdown_connections 2024-04-26T07:29:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.968+0000 7f32c9714700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f32c413ea20 0x7f32c412c8f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.968+0000 7f32c9714700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32c40679d0 0x7f32c4135860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.968+0000 7f32c9714700 1 --2- 172.21.15.31:0/1388348125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32c41335d0 0x7f32c412c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.968+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 >> 172.21.15.31:0/1388348125 conn(0x7f32c4060ee0 msgr2=0x7f32c4130850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.969+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 shutdown_connections 2024-04-26T07:29:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:46.969+0000 7f32c9714700 1 -- 172.21.15.31:0/1388348125 wait complete. 2024-04-26T07:29:46.979 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:29:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.088+0000 7f54daa30700 1 Processor -- start 2024-04-26T07:29:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.088+0000 7f54daa30700 1 -- start start 2024-04-26T07:29:47.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54daa30700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a22a0 0x7f54d409c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54daa30700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54d40a3880 0x7f54d413e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54daa30700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d409d150 con 0x7f54d40a2680 2024-04-26T07:29:47.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54daa30700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d409dd80 con 0x7f54d40a3880 2024-04-26T07:29:47.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54daa30700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54d409ce90 con 0x7f54d40a22a0 2024-04-26T07:29:47.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d8fcd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54d40a3880 0x7f54d413e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f54d40a2680 0x7f54d40a3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59472/0 (socket says 172.21.15.31:59472) 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d37fe700 1 -- 172.21.15.31:0/3557474016 learned_addr learned my addr 172.21.15.31:0/3557474016 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a22a0 0x7f54d409c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d3fff700 1 -- 172.21.15.31:0/3557474016 >> v2:172.21.15.31:3300/0 conn(0x7f54d40a3880 msgr2=0x7f54d413e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d3fff700 1 --2- 172.21.15.31:0/3557474016 >> v2:172.21.15.31:3300/0 conn(0x7f54d40a3880 0x7f54d413e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d3fff700 1 -- 172.21.15.31:0/3557474016 >> v1:172.21.15.31:6789/0 conn(0x7f54d40a2680 legacy=0x7f54d40a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d2ffd700 1 -- 172.21.15.31:0/3557474016 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551031045 0 0) 0x7f54d409d150 con 0x7f54d40a2680 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d3fff700 1 -- 172.21.15.31:0/3557474016 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d409e2d0 con 0x7f54d40a22a0 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d8fcd700 1 --2- 172.21.15.31:0/3557474016 >> v2:172.21.15.31:3300/0 conn(0x7f54d40a3880 0x7f54d413e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:47.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d3fff700 1 --2- 172.21.15.31:0/3557474016 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a22a0 0x7f54d409c7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f54bc002f70 tx=0x7f54bc006df0).ready entity=mon.2 client_cookie=621ec8249d5234f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d2ffd700 1 -- 172.21.15.31:0/3557474016 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54bc00d570 con 0x7f54d40a22a0 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d2ffd700 1 -- 172.21.15.31:0/3557474016 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc000e90 con 0x7f54d40a22a0 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.089+0000 7f54d2ffd700 1 -- 172.21.15.31:0/3557474016 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54bc00d8c0 con 0x7f54d40a22a0 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.090+0000 7f54daa30700 1 -- 172.21.15.31:0/3557474016 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a22a0 msgr2=0x7f54d409c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.090+0000 7f54daa30700 1 --2- 172.21.15.31:0/3557474016 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a22a0 0x7f54d409c7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f54bc002f70 tx=0x7f54bc006df0).stop 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.090+0000 7f54daa30700 1 -- 172.21.15.31:0/3557474016 shutdown_connections 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.090+0000 7f54daa30700 1 --2- 172.21.15.31:0/3557474016 >> v2:172.21.15.31:3300/0 conn(0x7f54d40a3880 0x7f54d413e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.090+0000 7f54daa30700 1 --2- 172.21.15.31:0/3557474016 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a22a0 0x7f54d409c7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.090+0000 7f54daa30700 1 -- 172.21.15.31:0/3557474016 >> 172.21.15.31:0/3557474016 conn(0x7f54d4060ee0 msgr2=0x7f54d40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.090+0000 7f54daa30700 1 -- 172.21.15.31:0/3557474016 shutdown_connections 2024-04-26T07:29:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.090+0000 7f54daa30700 1 -- 172.21.15.31:0/3557474016 wait complete. 2024-04-26T07:29:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.091+0000 7f54daa30700 1 Processor -- start 2024-04-26T07:29:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.091+0000 7f54daa30700 1 -- start start 2024-04-26T07:29:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.091+0000 7f54daa30700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54d40a22a0 0x7f54d4096ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.091+0000 7f54daa30700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a2680 0x7f54d4135580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.091+0000 7f54daa30700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54d40a3880 0x7f54d4135a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54daa30700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4094720 con 0x7f54d40a22a0 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54daa30700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40949e0 con 0x7f54d40a3880 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54daa30700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4135f60 con 0x7f54d40a2680 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54d40a22a0 0x7f54d4096ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a2680 0x7f54d4135580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54d40a22a0 0x7f54d4096ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54284/0 (socket says 172.21.15.31:54284) 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d3fff700 1 -- 172.21.15.31:0/3706683395 learned_addr learned my addr 172.21.15.31:0/3706683395 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d8fcd700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54d40a3880 0x7f54d4135a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d37fe700 1 -- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54d40a3880 msgr2=0x7f54d4135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d37fe700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54d40a3880 0x7f54d4135a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d37fe700 1 -- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54d40a22a0 msgr2=0x7f54d4096ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d37fe700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54d40a22a0 0x7f54d4096ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d37fe700 1 -- 172.21.15.31:0/3706683395 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc009470 con 0x7f54d40a2680 2024-04-26T07:29:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d3fff700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54d40a22a0 0x7f54d4096ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d37fe700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a2680 0x7f54d4135580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f54c4000bc0 tx=0x7f54c4007a70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d17fa700 1 -- 172.21.15.31:0/3706683395 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c4013070 con 0x7f54d40a2680 2024-04-26T07:29:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d17fa700 1 -- 172.21.15.31:0/3706683395 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c40072c0 con 0x7f54d40a2680 2024-04-26T07:29:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc00b180 con 0x7f54d40a2680 2024-04-26T07:29:47.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54d17fa700 1 -- 172.21.15.31:0/3706683395 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c4005610 con 0x7f54d40a2680 2024-04-26T07:29:47.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.092+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d409bee0 con 0x7f54d40a2680 2024-04-26T07:29:47.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.093+0000 7f54d17fa700 1 -- 172.21.15.31:0/3706683395 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f54c4020070 con 0x7f54d40a2680 2024-04-26T07:29:47.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.093+0000 7f54d17fa700 1 -- 172.21.15.31:0/3706683395 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f54c404e030 con 0x7f54d40a2680 2024-04-26T07:29:47.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.093+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d4066620 con 0x7f54d40a2680 2024-04-26T07:29:47.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.097+0000 7f54d17fa700 1 -- 172.21.15.31:0/3706683395 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f54c4032f30 con 0x7f54d40a2680 2024-04-26T07:29:47.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.213+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54d406bbc0 con 0x7f54d40a2680 2024-04-26T07:29:47.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.213+0000 7f54d17fa700 1 -- 172.21.15.31:0/3706683395 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54c4036550 con 0x7f54d40a2680 2024-04-26T07:29:47.213 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:29:47.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 >> v1:172.21.15.31:6816/39613 conn(0x7f54b8038dd0 legacy=0x7f54b803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a2680 msgr2=0x7f54d4135580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a2680 0x7f54d4135580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f54c4000bc0 tx=0x7f54c4007a70).stop 2024-04-26T07:29:47.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 shutdown_connections 2024-04-26T07:29:47.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54d40a3880 0x7f54d4135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54d40a22a0 0x7f54d4096ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 --2- 172.21.15.31:0/3706683395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f54d40a2680 0x7f54d4135580 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 >> 172.21.15.31:0/3706683395 conn(0x7f54d4060ee0 msgr2=0x7f54d40670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:47.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 shutdown_connections 2024-04-26T07:29:47.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.214+0000 7f54daa30700 1 -- 172.21.15.31:0/3706683395 wait complete. 2024-04-26T07:29:47.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T07:29:47.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.334+0000 7f69a57e0700 1 Processor -- start 2024-04-26T07:29:47.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.334+0000 7f69a57e0700 1 -- start start 2024-04-26T07:29:47.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.334+0000 7f69a57e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a0136000 0x7f69a005cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.334+0000 7f69a57e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69a01367a0 0x7f69a0136c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f69a57e0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a00a81c0 con 0x7f69a00a7de0 2024-04-26T07:29:47.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f69a57e0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a005c9a0 con 0x7f69a01367a0 2024-04-26T07:29:47.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f69a57e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0136500 con 0x7f69a0136000 2024-04-26T07:29:47.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699e7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a0136000 0x7f69a005cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69a01367a0 0x7f69a0136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f69a00a7de0 0x7f69a00ac380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59484/0 (socket says 172.21.15.31:59484) 2024-04-26T07:29:47.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699effd700 1 -- 172.21.15.31:0/2477875622 learned_addr learned my addr 172.21.15.31:0/2477875622 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:47.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699f7fe700 1 --2- 172.21.15.31:0/2477875622 >> v2:172.21.15.31:3300/0 conn(0x7f69a01367a0 0x7f69a0136c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54296/0 (socket says 172.21.15.31:54296) 2024-04-26T07:29:47.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699e7fc700 1 --2- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a0136000 0x7f69a005cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54298/0 (socket says 172.21.15.31:54298) 2024-04-26T07:29:47.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699f7fe700 1 -- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a0136000 msgr2=0x7f69a005cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:47.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699f7fe700 1 --2- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a0136000 0x7f69a005cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699f7fe700 1 -- 172.21.15.31:0/2477875622 >> v1:172.21.15.31:6789/0 conn(0x7f69a00a7de0 legacy=0x7f69a00ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699dffb700 1 -- 172.21.15.31:0/2477875622 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510221887 0 0) 0x7f69a00a81c0 con 0x7f69a00a7de0 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699f7fe700 1 -- 172.21.15.31:0/2477875622 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a005d7a0 con 0x7f69a01367a0 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699e7fc700 1 --2- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a0136000 0x7f69a005cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699f7fe700 1 --2- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a01367a0 0x7f69a0136c10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f69980032f0 tx=0x7f69980091d0).ready entity=mon.0 client_cookie=f45aaca1889057f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699dffb700 1 -- 172.21.15.31:0/2477875622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f699800b6c0 con 0x7f69a01367a0 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699dffb700 1 -- 172.21.15.31:0/2477875622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699800b820 con 0x7f69a01367a0 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.335+0000 7f699dffb700 1 -- 172.21.15.31:0/2477875622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f699800b990 con 0x7f69a01367a0 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.336+0000 7f69a57e0700 1 -- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a01367a0 msgr2=0x7f69a0136c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.336+0000 7f69a57e0700 1 --2- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a01367a0 0x7f69a0136c10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f69980032f0 tx=0x7f69980091d0).stop 2024-04-26T07:29:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.336+0000 7f69a57e0700 1 -- 172.21.15.31:0/2477875622 shutdown_connections 2024-04-26T07:29:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.336+0000 7f69a57e0700 1 --2- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a01367a0 0x7f69a0136c10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.336+0000 7f69a57e0700 1 --2- 172.21.15.31:0/2477875622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a0136000 0x7f69a005cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.336+0000 7f69a57e0700 1 -- 172.21.15.31:0/2477875622 >> 172.21.15.31:0/2477875622 conn(0x7f69a0061380 msgr2=0x7f69a0066b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.336+0000 7f69a57e0700 1 -- 172.21.15.31:0/2477875622 shutdown_connections 2024-04-26T07:29:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.336+0000 7f69a57e0700 1 -- 172.21.15.31:0/2477875622 wait complete. 2024-04-26T07:29:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f69a57e0700 1 Processor -- start 2024-04-26T07:29:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f69a57e0700 1 -- start start 2024-04-26T07:29:47.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f69a57e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a00a7de0 0x7f69a0131170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f69a57e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69a0136000 0x7f69a0148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f69a57e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a01367a0 0x7f69a01494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f69a57e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0131930 con 0x7f69a00a7de0 2024-04-26T07:29:47.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f69a57e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0130a70 con 0x7f69a0136000 2024-04-26T07:29:47.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f69a57e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0130c70 con 0x7f69a01367a0 2024-04-26T07:29:47.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f699effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a00a7de0 0x7f69a0131170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f699effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a00a7de0 0x7f69a0131170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54298/0 (socket says 172.21.15.31:54298) 2024-04-26T07:29:47.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f699f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a01367a0 0x7f69a01494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f699effd700 1 -- 172.21.15.31:0/3598507825 learned_addr learned my addr 172.21.15.31:0/3598507825 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.337+0000 7f699e7fc700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69a0136000 0x7f69a0148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f699f7fe700 1 -- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69a0136000 msgr2=0x7f69a0148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f699f7fe700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69a0136000 0x7f69a0148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f699f7fe700 1 -- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a00a7de0 msgr2=0x7f69a0131170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f699f7fe700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a00a7de0 0x7f69a0131170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f699f7fe700 1 -- 172.21.15.31:0/3598507825 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699400b180 con 0x7f69a01367a0 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f699effd700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a00a7de0 0x7f69a0131170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:47.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f699f7fe700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a01367a0 0x7f69a01494a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f69a012c1d0 tx=0x7f6998016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f698ffff700 1 -- 172.21.15.31:0/3598507825 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f699800b990 con 0x7f69a01367a0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f698ffff700 1 -- 172.21.15.31:0/3598507825 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6998021630 con 0x7f69a01367a0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6998009470 con 0x7f69a01367a0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f698ffff700 1 -- 172.21.15.31:0/3598507825 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f699800b6c0 con 0x7f69a01367a0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.338+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a012fc00 con 0x7f69a01367a0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.339+0000 7f698ffff700 1 -- 172.21.15.31:0/3598507825 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6998027020 con 0x7f69a01367a0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.339+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a012dd80 con 0x7f69a01367a0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.339+0000 7f698ffff700 1 -- 172.21.15.31:0/3598507825 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f699804bb70 con 0x7f69a01367a0 2024-04-26T07:29:47.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.342+0000 7f698ffff700 1 -- 172.21.15.31:0/3598507825 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6998006510 con 0x7f69a01367a0 2024-04-26T07:29:47.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.459+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69a0140970 con 0x7f69a01367a0 2024-04-26T07:29:47.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.459+0000 7f698ffff700 1 -- 172.21.15.31:0/3598507825 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6998008c40 con 0x7f69a01367a0 2024-04-26T07:29:47.460 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-26T07:29:47.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 >> v1:172.21.15.31:6816/39613 conn(0x7f697c038da0 legacy=0x7f697c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a01367a0 msgr2=0x7f69a01494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a01367a0 0x7f69a01494a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f69a012c1d0 tx=0x7f6998016000).stop 2024-04-26T07:29:47.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 shutdown_connections 2024-04-26T07:29:47.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69a01367a0 0x7f69a01494a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69a00a7de0 0x7f69a0131170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 --2- 172.21.15.31:0/3598507825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69a0136000 0x7f69a0148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 >> 172.21.15.31:0/3598507825 conn(0x7f69a0061380 msgr2=0x7f69a006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:47.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 shutdown_connections 2024-04-26T07:29:47.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.460+0000 7f69a57e0700 1 -- 172.21.15.31:0/3598507825 wait complete. 2024-04-26T07:29:47.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T07:29:47.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.580+0000 7f065cc70700 1 Processor -- start 2024-04-26T07:29:47.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.580+0000 7f065cc70700 1 -- start start 2024-04-26T07:29:47.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065cc70700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f06580a3660 0x7f065809c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065cc70700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f06581363c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065cc70700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580a3170 con 0x7f06580a3e20 2024-04-26T07:29:47.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065cc70700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065809ccc0 con 0x7f06580a3660 2024-04-26T07:29:47.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065cc70700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f065809cf00 con 0x7f06580a3a40 2024-04-26T07:29:47.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0655d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f06581363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f06580a3660 0x7f065809c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0655d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f06581363c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52864/0 (socket says 172.21.15.31:52864) 2024-04-26T07:29:47.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0655d9b700 1 -- 172.21.15.31:0/3733292368 learned_addr learned my addr 172.21.15.31:0/3733292368 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:47.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0656d9d700 1 --1- 172.21.15.31:0/3733292368 >> v1:172.21.15.31:6789/0 conn(0x7f06580a3e20 0x7f06581368b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57516/0 (socket says 172.21.15.31:57516) 2024-04-26T07:29:47.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0655d9b700 1 -- 172.21.15.31:0/3733292368 >> v2:172.21.15.31:3300/0 conn(0x7f06580a3660 msgr2=0x7f065809c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:47.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0655d9b700 1 --2- 172.21.15.31:0/3733292368 >> v2:172.21.15.31:3300/0 conn(0x7f06580a3660 0x7f065809c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0655d9b700 1 -- 172.21.15.31:0/3733292368 >> v1:172.21.15.31:6789/0 conn(0x7f06580a3e20 legacy=0x7f06581368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065559a700 1 -- 172.21.15.31:0/3733292368 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141137536 0 0) 0x7f06580a3170 con 0x7f06580a3e20 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0655d9b700 1 -- 172.21.15.31:0/3733292368 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065809eb40 con 0x7f06580a3a40 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065659c700 1 --2- 172.21.15.31:0/3733292368 >> v2:172.21.15.31:3300/0 conn(0x7f06580a3660 0x7f065809c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f0655d9b700 1 --2- 172.21.15.31:0/3733292368 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f06581363c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f064c002f70 tx=0x7f064c006eb0).ready entity=mon.2 client_cookie=af52c2aa878c45d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065559a700 1 -- 172.21.15.31:0/3733292368 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c00d570 con 0x7f06580a3a40 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065559a700 1 -- 172.21.15.31:0/3733292368 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c000e90 con 0x7f06580a3a40 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.581+0000 7f065559a700 1 -- 172.21.15.31:0/3733292368 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064c00d8c0 con 0x7f06580a3a40 2024-04-26T07:29:47.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.582+0000 7f065cc70700 1 -- 172.21.15.31:0/3733292368 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 msgr2=0x7f06581363c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.582+0000 7f065cc70700 1 --2- 172.21.15.31:0/3733292368 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f06581363c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f064c002f70 tx=0x7f064c006eb0).stop 2024-04-26T07:29:47.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.582+0000 7f065cc70700 1 -- 172.21.15.31:0/3733292368 shutdown_connections 2024-04-26T07:29:47.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.582+0000 7f065cc70700 1 --2- 172.21.15.31:0/3733292368 >> v2:172.21.15.31:3300/0 conn(0x7f06580a3660 0x7f065809c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.582+0000 7f065cc70700 1 --2- 172.21.15.31:0/3733292368 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f06581363c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.582+0000 7f065cc70700 1 -- 172.21.15.31:0/3733292368 >> 172.21.15.31:0/3733292368 conn(0x7f0658060ee0 msgr2=0x7f06580a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:47.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.582+0000 7f065cc70700 1 -- 172.21.15.31:0/3733292368 shutdown_connections 2024-04-26T07:29:47.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.582+0000 7f065cc70700 1 -- 172.21.15.31:0/3733292368 wait complete. 2024-04-26T07:29:47.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.583+0000 7f065cc70700 1 Processor -- start 2024-04-26T07:29:47.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.583+0000 7f065cc70700 1 -- start start 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065cc70700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06580a3660 0x7f0658093330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065cc70700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f0658132090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065cc70700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06580a3e20 0x7f0658132580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065cc70700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0658094fe0 con 0x7f06580a3e20 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065cc70700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06580938e0 con 0x7f06580a3660 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065cc70700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0658093ba0 con 0x7f06580a3a40 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06580a3660 0x7f0658093330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f0656d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06580a3e20 0x7f0658132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06580a3660 0x7f0658093330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46914/0 (socket says 172.21.15.31:46914) 2024-04-26T07:29:47.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f0656d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06580a3e20 0x7f0658132580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58698/0 (socket says 172.21.15.31:58698) 2024-04-26T07:29:47.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 -- 172.21.15.31:0/1129696618 learned_addr learned my addr 172.21.15.31:0/1129696618 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:47.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f0655d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f0658132090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 -- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 msgr2=0x7f0658132090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 --2- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f0658132090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 -- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06580a3e20 msgr2=0x7f0658132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 --2- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06580a3e20 0x7f0658132580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 -- 172.21.15.31:0/1129696618 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064800b180 con 0x7f06580a3660 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f0656d9d700 1 --2- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06580a3e20 0x7f0658132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.584+0000 7f065659c700 1 --2- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06580a3660 0x7f0658093330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f064800c000 tx=0x7f0648006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.585+0000 7f06477fe700 1 -- 172.21.15.31:0/1129696618 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064800c7e0 con 0x7f06580a3660 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.585+0000 7f06477fe700 1 -- 172.21.15.31:0/1129696618 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064800c940 con 0x7f06580a3660 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.585+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c00b1e0 con 0x7f06580a3660 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.585+0000 7f06477fe700 1 -- 172.21.15.31:0/1129696618 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f064800cca0 con 0x7f06580a3660 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.585+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06580677f0 con 0x7f06580a3660 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.586+0000 7f06477fe700 1 -- 172.21.15.31:0/1129696618 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f064801c460 con 0x7f06580a3660 2024-04-26T07:29:47.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.586+0000 7f06477fe700 1 -- 172.21.15.31:0/1129696618 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f064804adf0 con 0x7f06580a3660 2024-04-26T07:29:47.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.586+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065806bbc0 con 0x7f06580a3660 2024-04-26T07:29:47.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.589+0000 7f06477fe700 1 -- 172.21.15.31:0/1129696618 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0648033720 con 0x7f06580a3660 2024-04-26T07:29:47.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.706+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0658095830 con 0x7f06580a3660 2024-04-26T07:29:47.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.706+0000 7f06477fe700 1 -- 172.21.15.31:0/1129696618 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f064800ce00 con 0x7f06580a3660 2024-04-26T07:29:47.706 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 >> v1:172.21.15.31:6816/39613 conn(0x7f0634038ec0 legacy=0x7f063403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06580a3660 msgr2=0x7f0658093330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 --2- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06580a3660 0x7f0658093330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f064800c000 tx=0x7f0648006df0).stop 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 shutdown_connections 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 --2- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06580a3e20 0x7f0658132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 --2- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f06580a3660 0x7f0658093330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 --2- 172.21.15.31:0/1129696618 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f06580a3a40 0x7f0658132090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 >> 172.21.15.31:0/1129696618 conn(0x7f0658060ee0 msgr2=0x7f06580a7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:47.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 shutdown_connections 2024-04-26T07:29:47.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.707+0000 7f065cc70700 1 -- 172.21.15.31:0/1129696618 wait complete. 2024-04-26T07:29:47.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T07:29:47.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.825+0000 7fdd0cf92700 1 Processor -- start 2024-04-26T07:29:47.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.825+0000 7fdd0cf92700 1 -- start start 2024-04-26T07:29:47.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd0cf92700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd08067500 0x7fdd0809a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd0cf92700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809c0a0 0x7fdd08136d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd0cf92700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0809b670 con 0x7fdd0809bc70 2024-04-26T07:29:47.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd0cf92700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd081361b0 con 0x7fdd08067500 2024-04-26T07:29:47.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd0cf92700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0809b400 con 0x7fdd0809c0a0 2024-04-26T07:29:47.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd06d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809c0a0 0x7fdd08136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd0659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd08067500 0x7fdd0809a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd06d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809c0a0 0x7fdd08136d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46924/0 (socket says 172.21.15.31:46924) 2024-04-26T07:29:47.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd0659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd08067500 0x7fdd0809a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58704/0 (socket says 172.21.15.31:58704) 2024-04-26T07:29:47.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd05d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdd0809bc70 0x7fdd08136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57530/0 (socket says 172.21.15.31:57530) 2024-04-26T07:29:47.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.826+0000 7fdd06d9d700 1 -- 172.21.15.31:0/2323770386 learned_addr learned my addr 172.21.15.31:0/2323770386 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:47.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd06d9d700 1 -- 172.21.15.31:0/2323770386 >> v2:172.21.15.31:3300/0 conn(0x7fdd08067500 msgr2=0x7fdd0809a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:47.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd06d9d700 1 --2- 172.21.15.31:0/2323770386 >> v2:172.21.15.31:3300/0 conn(0x7fdd08067500 0x7fdd0809a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd06d9d700 1 -- 172.21.15.31:0/2323770386 >> v1:172.21.15.31:6789/0 conn(0x7fdd0809bc70 legacy=0x7fdd08136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd06d9d700 1 -- 172.21.15.31:0/2323770386 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd081363a0 con 0x7fdd0809c0a0 2024-04-26T07:29:47.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0559a700 1 -- 172.21.15.31:0/2323770386 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232561435 0 0) 0x7fdd0809b670 con 0x7fdd0809bc70 2024-04-26T07:29:47.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0659c700 1 --2- 172.21.15.31:0/2323770386 >> v2:172.21.15.31:3300/0 conn(0x7fdd08067500 0x7fdd0809a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:47.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd06d9d700 1 --2- 172.21.15.31:0/2323770386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809c0a0 0x7fdd08136d70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fdd000032f0 tx=0x7fdd00009290).ready entity=mon.1 client_cookie=dc128c5b1b32d72e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:47.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0559a700 1 -- 172.21.15.31:0/2323770386 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0000b8a0 con 0x7fdd0809c0a0 2024-04-26T07:29:47.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0559a700 1 -- 172.21.15.31:0/2323770386 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0000ba00 con 0x7fdd0809c0a0 2024-04-26T07:29:47.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0559a700 1 -- 172.21.15.31:0/2323770386 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0000bb70 con 0x7fdd0809c0a0 2024-04-26T07:29:47.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0cf92700 1 -- 172.21.15.31:0/2323770386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809c0a0 msgr2=0x7fdd08136d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0cf92700 1 --2- 172.21.15.31:0/2323770386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809c0a0 0x7fdd08136d70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fdd000032f0 tx=0x7fdd00009290).stop 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0cf92700 1 -- 172.21.15.31:0/2323770386 shutdown_connections 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0cf92700 1 --2- 172.21.15.31:0/2323770386 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809c0a0 0x7fdd08136d70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0cf92700 1 --2- 172.21.15.31:0/2323770386 >> v2:172.21.15.31:3300/0 conn(0x7fdd08067500 0x7fdd0809a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0cf92700 1 -- 172.21.15.31:0/2323770386 >> 172.21.15.31:0/2323770386 conn(0x7fdd0805cfb0 msgr2=0x7fdd08062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0cf92700 1 -- 172.21.15.31:0/2323770386 shutdown_connections 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.827+0000 7fdd0cf92700 1 -- 172.21.15.31:0/2323770386 wait complete. 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.828+0000 7fdd0cf92700 1 Processor -- start 2024-04-26T07:29:47.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.828+0000 7fdd0cf92700 1 -- start start 2024-04-26T07:29:47.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0cf92700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd08067500 0x7fdd08093f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0cf92700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809bc70 0x7fdd08095360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0cf92700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0809c0a0 0x7fdd08130e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:47.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0cf92700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08094b40 con 0x7fdd0809c0a0 2024-04-26T07:29:47.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0cf92700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08094d40 con 0x7fdd0809bc70 2024-04-26T07:29:47.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0cf92700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08093070 con 0x7fdd08067500 2024-04-26T07:29:47.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd08067500 0x7fdd08093f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd05d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809bc70 0x7fdd08095360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd08067500 0x7fdd08093f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52880/0 (socket says 172.21.15.31:52880) 2024-04-26T07:29:47.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd06d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0809c0a0 0x7fdd08130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:47.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 -- 172.21.15.31:0/1427547297 learned_addr learned my addr 172.21.15.31:0/1427547297 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:47.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 -- 172.21.15.31:0/1427547297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809bc70 msgr2=0x7fdd08095360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 --2- 172.21.15.31:0/1427547297 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0809bc70 0x7fdd08095360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 -- 172.21.15.31:0/1427547297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0809c0a0 msgr2=0x7fdd08130e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 --2- 172.21.15.31:0/1427547297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0809c0a0 0x7fdd08130e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 -- 172.21.15.31:0/1427547297 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf000b180 con 0x7fdd08067500 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd06d9d700 1 --2- 172.21.15.31:0/1427547297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0809c0a0 0x7fdd08130e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.829+0000 7fdd0659c700 1 --2- 172.21.15.31:0/1427547297 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd08067500 0x7fdd08093f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fdd08092af0 tx=0x7fdcf0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.830+0000 7fdcff7fe700 1 -- 172.21.15.31:0/1427547297 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcf000c5f0 con 0x7fdd08067500 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.830+0000 7fdcff7fe700 1 -- 172.21.15.31:0/1427547297 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf000c750 con 0x7fdd08067500 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.830+0000 7fdd0cf92700 1 -- 172.21.15.31:0/1427547297 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd00009530 con 0x7fdd08067500 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.830+0000 7fdcff7fe700 1 -- 172.21.15.31:0/1427547297 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcf000cab0 con 0x7fdd08067500 2024-04-26T07:29:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.830+0000 7fdd0cf92700 1 -- 172.21.15.31:0/1427547297 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd08091fa0 con 0x7fdd08067500 2024-04-26T07:29:47.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.830+0000 7fdcff7fe700 1 -- 172.21.15.31:0/1427547297 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdcf000cc10 con 0x7fdd08067500 2024-04-26T07:29:47.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.831+0000 7fdcff7fe700 1 -- 172.21.15.31:0/1427547297 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdcf004add0 con 0x7fdd08067500 2024-04-26T07:29:47.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.831+0000 7fdd0cf92700 1 -- 172.21.15.31:0/1427547297 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd08094610 con 0x7fdd08067500 2024-04-26T07:29:47.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:47.834+0000 7fdcff7fe700 1 -- 172.21.15.31:0/1427547297 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdcf0033660 con 0x7fdd08067500 2024-04-26T07:29:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:no valid command found; 10 closest matches: 2024-04-26T07:29:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:osd perf 2024-04-26T07:29:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:osd df [plain|tree] [class|name] [] 2024-04-26T07:29:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:osd blocked-by 2024-04-26T07:29:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool stats [] 2024-04-26T07:29:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool scrub ... 2024-04-26T07:29:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool deep-scrub ... 2024-04-26T07:29:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool repair ... 2024-04-26T07:29:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool force-recovery ... 2024-04-26T07:29:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool force-backfill ... 2024-04-26T07:29:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool cancel-force-recovery ... 2024-04-26T07:29:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:Error EINVAL: invalid command 2024-04-26T07:29:47.995 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T07:29:47.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-04-26T07:29:48.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.103+0000 7f6544dd1700 1 Processor -- start 2024-04-26T07:29:48.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.103+0000 7f6544dd1700 1 -- start start 2024-04-26T07:29:48.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f6544dd1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f654006c990 0x7f6540136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:48.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f6544dd1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 0x7f65401337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f6544dd1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654006cd70 con 0x7f65400648b0 2024-04-26T07:29:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f6544dd1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6540137340 con 0x7f654006c990 2024-04-26T07:29:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f6544dd1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6540132eb0 con 0x7f6540133340 2024-04-26T07:29:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653e59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f654006c990 0x7f6540136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653dd9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f65400648b0 0x7f6540136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57546/0 (socket says 172.21.15.31:57546) 2024-04-26T07:29:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653dd9b700 1 -- 172.21.15.31:0/3227120908 learned_addr learned my addr 172.21.15.31:0/3227120908 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653ed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 0x7f65401337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:48.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653e59c700 1 -- 172.21.15.31:0/3227120908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 msgr2=0x7f65401337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653e59c700 1 --2- 172.21.15.31:0/3227120908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 0x7f65401337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653e59c700 1 -- 172.21.15.31:0/3227120908 >> v1:172.21.15.31:6789/0 conn(0x7f65400648b0 legacy=0x7f6540136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653e59c700 1 -- 172.21.15.31:0/3227120908 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540063c00 con 0x7f654006c990 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653d59a700 1 -- 172.21.15.31:0/3227120908 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676661461 0 0) 0x7f654006cd70 con 0x7f65400648b0 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653e59c700 1 --2- 172.21.15.31:0/3227120908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 0x7f6540136400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6530002f70 tx=0x7f6530006df0).ready entity=mon.0 client_cookie=92844e468e4f15b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653d59a700 1 -- 172.21.15.31:0/3227120908 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f653000d570 con 0x7f654006c990 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653d59a700 1 -- 172.21.15.31:0/3227120908 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6530000e90 con 0x7f654006c990 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.104+0000 7f653d59a700 1 -- 172.21.15.31:0/3227120908 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f653000d8c0 con 0x7f654006c990 2024-04-26T07:29:48.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.105+0000 7f6544dd1700 1 -- 172.21.15.31:0/3227120908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 msgr2=0x7f6540136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.105+0000 7f6544dd1700 1 --2- 172.21.15.31:0/3227120908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 0x7f6540136400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6530002f70 tx=0x7f6530006df0).stop 2024-04-26T07:29:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.105+0000 7f6544dd1700 1 -- 172.21.15.31:0/3227120908 shutdown_connections 2024-04-26T07:29:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.105+0000 7f6544dd1700 1 --2- 172.21.15.31:0/3227120908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 0x7f65401337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.105+0000 7f6544dd1700 1 --2- 172.21.15.31:0/3227120908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 0x7f6540136400 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.105+0000 7f6544dd1700 1 -- 172.21.15.31:0/3227120908 >> 172.21.15.31:0/3227120908 conn(0x7f6540061370 msgr2=0x7f654006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.105+0000 7f6544dd1700 1 -- 172.21.15.31:0/3227120908 shutdown_connections 2024-04-26T07:29:48.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.105+0000 7f6544dd1700 1 -- 172.21.15.31:0/3227120908 wait complete. 2024-04-26T07:29:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.106+0000 7f6544dd1700 1 Processor -- start 2024-04-26T07:29:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.106+0000 7f6544dd1700 1 -- start start 2024-04-26T07:29:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f6544dd1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f65400648b0 0x7f65401304e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f6544dd1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 0x7f6540144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f6544dd1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 0x7f6540144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f6544dd1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6540132420 con 0x7f654006c990 2024-04-26T07:29:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f6544dd1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654012e8f0 con 0x7f6540133340 2024-04-26T07:29:48.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f6544dd1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65400673c0 con 0x7f65400648b0 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653e59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f65400648b0 0x7f65401304e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 0x7f6540144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653e59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f65400648b0 0x7f65401304e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52892/0 (socket says 172.21.15.31:52892) 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653e59c700 1 -- 172.21.15.31:0/921800692 learned_addr learned my addr 172.21.15.31:0/921800692 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653ed9d700 1 --2- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 0x7f6540144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653dd9b700 1 -- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f65400648b0 msgr2=0x7f65401304e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653dd9b700 1 --2- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f65400648b0 0x7f65401304e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653dd9b700 1 -- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 msgr2=0x7f6540144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653dd9b700 1 --2- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 0x7f6540144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653dd9b700 1 -- 172.21.15.31:0/921800692 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653000b180 con 0x7f654006c990 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f653dd9b700 1 --2- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 0x7f6540144a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f654012edb0 tx=0x7f65280079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.107+0000 7f65377fe700 1 -- 172.21.15.31:0/921800692 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f652800cdf0 con 0x7f654006c990 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.108+0000 7f65377fe700 1 -- 172.21.15.31:0/921800692 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280070d0 con 0x7f654006c990 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.108+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654012f5a0 con 0x7f654006c990 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.108+0000 7f65377fe700 1 -- 172.21.15.31:0/921800692 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6528007430 con 0x7f654006c990 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.108+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65400679a0 con 0x7f654006c990 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.109+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6540130330 con 0x7f654006c990 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.109+0000 7f65377fe700 1 -- 172.21.15.31:0/921800692 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6528010070 con 0x7f654006c990 2024-04-26T07:29:48.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.109+0000 7f65377fe700 1 -- 172.21.15.31:0/921800692 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6528049de0 con 0x7f654006c990 2024-04-26T07:29:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.112+0000 7f65377fe700 1 -- 172.21.15.31:0/921800692 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f652802ece0 con 0x7f654006c990 2024-04-26T07:29:48.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.243+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) v1 -- 0x7f65400679a0 con 0x7f654006c990 2024-04-26T07:29:48.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.243+0000 7f65377fe700 1 -- 172.21.15.31:0/921800692 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v19) v1 ==== 80+0+0 (secure 0 0 0) 0x7f65400679a0 con 0x7f654006c990 2024-04-26T07:29:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 >> v1:172.21.15.31:6816/39613 conn(0x7f6524038f50 legacy=0x7f652403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 msgr2=0x7f6540144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 --2- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 0x7f6540144a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f654012edb0 tx=0x7f65280079e0).stop 2024-04-26T07:29:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 shutdown_connections 2024-04-26T07:29:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 --2- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f65400648b0 0x7f65401304e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 --2- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6540133340 0x7f6540144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 --2- 172.21.15.31:0/921800692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f654006c990 0x7f6540144a80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 >> 172.21.15.31:0/921800692 conn(0x7f6540061370 msgr2=0x7f6540099810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 shutdown_connections 2024-04-26T07:29:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:48.245+0000 7f6544dd1700 1 -- 172.21.15.31:0/921800692 wait complete. 2024-04-26T07:29:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-04-26T07:29:48.255 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi057.front.sepia.ceph.com... 2024-04-26T07:29:48.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:29:48.256 DEBUG:teuthology.orchestra.run.smithi057:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T07:29:48.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[37426]: fuse finished with error 0 and tester_r 0 2024-04-26T07:29:48.304 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:29:54.406 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2024-04-26T07:29:54.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:29:54.407 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T07:29:54.445 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:29:54.445 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T07:29:54.469 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:29:54.469 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T07:29:54.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:29:54.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.649+0000 7f0cd713d700 1 Processor -- start 2024-04-26T07:29:54.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.649+0000 7f0cd713d700 1 -- start start 2024-04-26T07:29:54.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd713d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd00ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd713d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd005cbb0 0x7f0cd0139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd713d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd005b970 con 0x7f0cd00aca60 2024-04-26T07:29:54.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd713d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd005c3d0 con 0x7f0cd005cbb0 2024-04-26T07:29:54.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd713d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd005d300 con 0x7f0cd00a8af0 2024-04-26T07:29:54.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0ccffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd00ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd4ed9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0cd00aca60 0x7f0cd0139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57548/0 (socket says 172.21.15.31:57548) 2024-04-26T07:29:54.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd4ed9700 1 -- 172.21.15.31:0/4136482642 learned_addr learned my addr 172.21.15.31:0/4136482642 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:54.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd56da700 1 --2- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd005cbb0 0x7f0cd0139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0ccf7fe700 1 -- 172.21.15.31:0/4136482642 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206376185 0 0) 0x7f0cd005b970 con 0x7f0cd00aca60 2024-04-26T07:29:54.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd56da700 1 -- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 msgr2=0x7f0cd00ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:54.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd56da700 1 --2- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd00ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd56da700 1 -- 172.21.15.31:0/4136482642 >> v1:172.21.15.31:6789/0 conn(0x7f0cd00aca60 legacy=0x7f0cd0139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0cd56da700 1 -- 172.21.15.31:0/4136482642 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00ac400 con 0x7f0cd005cbb0 2024-04-26T07:29:54.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.650+0000 7f0ccffff700 1 --2- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd00ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:54.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd56da700 1 --2- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd005cbb0 0x7f0cd0139c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0cc80032f0 tx=0x7f0cc80091d0).ready entity=mon.1 client_cookie=7e3a4e86530b501a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:54.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0ccf7fe700 1 -- 172.21.15.31:0/4136482642 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cc800b6c0 con 0x7f0cd005cbb0 2024-04-26T07:29:54.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0ccf7fe700 1 -- 172.21.15.31:0/4136482642 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc800b820 con 0x7f0cd005cbb0 2024-04-26T07:29:54.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0ccf7fe700 1 -- 172.21.15.31:0/4136482642 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cc800b990 con 0x7f0cd005cbb0 2024-04-26T07:29:54.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd713d700 1 -- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd005cbb0 msgr2=0x7f0cd0139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd713d700 1 --2- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd005cbb0 0x7f0cd0139c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0cc80032f0 tx=0x7f0cc80091d0).stop 2024-04-26T07:29:54.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd713d700 1 -- 172.21.15.31:0/4136482642 shutdown_connections 2024-04-26T07:29:54.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd713d700 1 --2- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd005cbb0 0x7f0cd0139c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd713d700 1 --2- 172.21.15.31:0/4136482642 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd00ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd713d700 1 -- 172.21.15.31:0/4136482642 >> 172.21.15.31:0/4136482642 conn(0x7f0cd0066d50 msgr2=0x7f0cd0067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd713d700 1 -- 172.21.15.31:0/4136482642 shutdown_connections 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.651+0000 7f0cd713d700 1 -- 172.21.15.31:0/4136482642 wait complete. 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.652+0000 7f0cd713d700 1 Processor -- start 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.652+0000 7f0cd713d700 1 -- start start 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd713d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cd005cbb0 0x7f0cd01198d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd713d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd0148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd713d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd00aca60 0x7f0cd01491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd713d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01172d0 con 0x7f0cd005cbb0 2024-04-26T07:29:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd713d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0117590 con 0x7f0cd00aca60 2024-04-26T07:29:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd713d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd013a100 con 0x7f0cd00a8af0 2024-04-26T07:29:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd4ed9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cd005cbb0 0x7f0cd01198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd56da700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd00aca60 0x7f0cd01491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0ccffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd0148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0ccffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd0148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52910/0 (socket says 172.21.15.31:52910) 2024-04-26T07:29:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd4ed9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cd005cbb0 0x7f0cd01198d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58728/0 (socket says 172.21.15.31:58728) 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd56da700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd00aca60 0x7f0cd01491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46958/0 (socket says 172.21.15.31:46958) 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0cd4ed9700 1 -- 172.21.15.31:0/2948252659 learned_addr learned my addr 172.21.15.31:0/2948252659 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0ccffff700 1 -- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd00aca60 msgr2=0x7f0cd01491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0ccffff700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd00aca60 0x7f0cd01491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0ccffff700 1 -- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cd005cbb0 msgr2=0x7f0cd01198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.653+0000 7f0ccffff700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cd005cbb0 0x7f0cd01198d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0ccffff700 1 -- 172.21.15.31:0/2948252659 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc00b180 con 0x7f0cd00a8af0 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0cd4ed9700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cd005cbb0 0x7f0cd01198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:54.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0cd56da700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd00aca60 0x7f0cd01491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0ccffff700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd0148cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0cbc00c000 tx=0x7f0cbc006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0ccdffb700 1 -- 172.21.15.31:0/2948252659 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cbc010780 con 0x7f0cd00a8af0 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0ccdffb700 1 -- 172.21.15.31:0/2948252659 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc0108e0 con 0x7f0cd00a8af0 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc8009470 con 0x7f0cd00a8af0 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0ccdffb700 1 -- 172.21.15.31:0/2948252659 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cbc010c40 con 0x7f0cd00a8af0 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.654+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd0116f20 con 0x7f0cd00a8af0 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.655+0000 7f0ccdffb700 1 -- 172.21.15.31:0/2948252659 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0cbc01c460 con 0x7f0cd00a8af0 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.655+0000 7f0ccdffb700 1 -- 172.21.15.31:0/2948252659 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0cbc04acf0 con 0x7f0cd00a8af0 2024-04-26T07:29:54.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.655+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd01168f0 con 0x7f0cd00a8af0 2024-04-26T07:29:54.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.658+0000 7f0ccdffb700 1 -- 172.21.15.31:0/2948252659 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0cd01168f0 con 0x7f0cd00a8af0 2024-04-26T07:29:54.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.775+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cd01168f0 con 0x7f0cd00a8af0 2024-04-26T07:29:54.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.776+0000 7f0ccdffb700 1 -- 172.21.15.31:0/2948252659 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7f0cd01168f0 con 0x7f0cd00a8af0 2024-04-26T07:29:54.776 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:54.776 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:45.886508+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:29:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 >> v1:172.21.15.31:6816/39613 conn(0x7f0cb0038e30 legacy=0x7f0cb003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 msgr2=0x7f0cd0148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd0148cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0cbc00c000 tx=0x7f0cbc006df0).stop 2024-04-26T07:29:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 shutdown_connections 2024-04-26T07:29:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cd00aca60 0x7f0cd01491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cd005cbb0 0x7f0cd01198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 --2- 172.21.15.31:0/2948252659 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0cd00a8af0 0x7f0cd0148cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 >> 172.21.15.31:0/2948252659 conn(0x7f0cd0066d50 msgr2=0x7f0cd0137b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 shutdown_connections 2024-04-26T07:29:54.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.777+0000 7f0cd713d700 1 -- 172.21.15.31:0/2948252659 wait complete. 2024-04-26T07:29:54.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T07:28:28.939656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T07:28:30.129744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T07:29:54.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:29:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.898+0000 7f4b82290700 1 Processor -- start 2024-04-26T07:29:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b82290700 1 -- start start 2024-04-26T07:29:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b82290700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c137a50 0x7f4b7c137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b82290700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c13c7d0 0x7f4b7c13ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b82290700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c137620 con 0x7f4b7c09ff30 2024-04-26T07:29:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b82290700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0a4e20 con 0x7f4b7c137a50 2024-04-26T07:29:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b82290700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c138320 con 0x7f4b7c13c7d0 2024-04-26T07:29:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c137a50 0x7f4b7c137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b8082d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c13c7d0 0x7f4b7c13ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c137a50 0x7f4b7c137e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46964/0 (socket says 172.21.15.31:46964) 2024-04-26T07:29:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b8082d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c13c7d0 0x7f4b7c13ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52912/0 (socket says 172.21.15.31:52912) 2024-04-26T07:29:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.899+0000 7f4b7bfff700 1 -- 172.21.15.31:0/1626599443 learned_addr learned my addr 172.21.15.31:0/1626599443 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:54.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7bfff700 1 -- 172.21.15.31:0/1626599443 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c13c7d0 msgr2=0x7f4b7c13ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7bfff700 1 --2- 172.21.15.31:0/1626599443 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c13c7d0 0x7f4b7c13ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7bfff700 1 -- 172.21.15.31:0/1626599443 >> v1:172.21.15.31:6789/0 conn(0x7f4b7c09ff30 legacy=0x7f4b7c0a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7affd700 1 -- 172.21.15.31:0/1626599443 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102068690 0 0) 0x7f4b7c137620 con 0x7f4b7c09ff30 2024-04-26T07:29:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7bfff700 1 -- 172.21.15.31:0/1626599443 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0a3960 con 0x7f4b7c137a50 2024-04-26T07:29:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b8082d700 1 --2- 172.21.15.31:0/1626599443 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c13c7d0 0x7f4b7c13ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7bfff700 1 --2- 172.21.15.31:0/1626599443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c137a50 0x7f4b7c137e30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4b6c002f70 tx=0x7f4b6c006eb0).ready entity=mon.1 client_cookie=5232c7003e84228f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7affd700 1 -- 172.21.15.31:0/1626599443 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c00d570 con 0x7f4b7c137a50 2024-04-26T07:29:54.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7affd700 1 -- 172.21.15.31:0/1626599443 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c000e90 con 0x7f4b7c137a50 2024-04-26T07:29:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b7affd700 1 -- 172.21.15.31:0/1626599443 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c00d8c0 con 0x7f4b7c137a50 2024-04-26T07:29:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b82290700 1 -- 172.21.15.31:0/1626599443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c137a50 msgr2=0x7f4b7c137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b82290700 1 --2- 172.21.15.31:0/1626599443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c137a50 0x7f4b7c137e30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4b6c002f70 tx=0x7f4b6c006eb0).stop 2024-04-26T07:29:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b82290700 1 -- 172.21.15.31:0/1626599443 shutdown_connections 2024-04-26T07:29:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b82290700 1 --2- 172.21.15.31:0/1626599443 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c13c7d0 0x7f4b7c13ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b82290700 1 --2- 172.21.15.31:0/1626599443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c137a50 0x7f4b7c137e30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.900+0000 7f4b82290700 1 -- 172.21.15.31:0/1626599443 >> 172.21.15.31:0/1626599443 conn(0x7f4b7c060ee0 msgr2=0x7f4b7c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:54.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.901+0000 7f4b82290700 1 -- 172.21.15.31:0/1626599443 shutdown_connections 2024-04-26T07:29:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.901+0000 7f4b82290700 1 -- 172.21.15.31:0/1626599443 wait complete. 2024-04-26T07:29:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.902+0000 7f4b82290700 1 Processor -- start 2024-04-26T07:29:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.902+0000 7f4b82290700 1 -- start start 2024-04-26T07:29:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.902+0000 7f4b82290700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c09ff30 0x7f4b7c143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b82290700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c137a50 0x7f4b7c064a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b82290700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b7c13c7d0 0x7f4b7c13aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b82290700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c146c70 con 0x7f4b7c13c7d0 2024-04-26T07:29:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b82290700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c146f30 con 0x7f4b7c09ff30 2024-04-26T07:29:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b82290700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c061790 con 0x7f4b7c137a50 2024-04-26T07:29:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c09ff30 0x7f4b7c143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c09ff30 0x7f4b7c143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46974/0 (socket says 172.21.15.31:46974) 2024-04-26T07:29:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 -- 172.21.15.31:0/1356784631 learned_addr learned my addr 172.21.15.31:0/1356784631 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7b7fe700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c137a50 0x7f4b7c064a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b8082d700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b7c13c7d0 0x7f4b7c13aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 -- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c137a50 msgr2=0x7f4b7c064a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c137a50 0x7f4b7c064a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 -- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b7c13c7d0 msgr2=0x7f4b7c13aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b7c13c7d0 0x7f4b7c13aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 -- 172.21.15.31:0/1356784631 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009470 con 0x7f4b7c09ff30 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b8082d700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b7c13c7d0 0x7f4b7c13aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b7bfff700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c09ff30 0x7f4b7c143630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4b6c002f70 tx=0x7f4b6c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b797fa700 1 -- 172.21.15.31:0/1356784631 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c00d8f0 con 0x7f4b7c09ff30 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b797fa700 1 -- 172.21.15.31:0/1356784631 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c011c30 con 0x7f4b7c09ff30 2024-04-26T07:29:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c00b1e0 con 0x7f4b7c09ff30 2024-04-26T07:29:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b797fa700 1 -- 172.21.15.31:0/1356784631 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c01d450 con 0x7f4b7c09ff30 2024-04-26T07:29:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.903+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c13af80 con 0x7f4b7c09ff30 2024-04-26T07:29:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.904+0000 7f4b797fa700 1 -- 172.21.15.31:0/1356784631 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4b6c024030 con 0x7f4b7c09ff30 2024-04-26T07:29:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.904+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c0a46a0 con 0x7f4b7c09ff30 2024-04-26T07:29:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.904+0000 7f4b797fa700 1 -- 172.21.15.31:0/1356784631 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4b6c04bb00 con 0x7f4b7c09ff30 2024-04-26T07:29:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:54.907+0000 7f4b797fa700 1 -- 172.21.15.31:0/1356784631 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4b6c0097f0 con 0x7f4b7c09ff30 2024-04-26T07:29:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.024+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4b7c06bbc0 con 0x7f4b7c09ff30 2024-04-26T07:29:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.024+0000 7f4b797fa700 1 -- 172.21.15.31:0/1356784631 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4b6c0093e0 con 0x7f4b7c09ff30 2024-04-26T07:29:55.024 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:29:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.025+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 >> v1:172.21.15.31:6816/39613 conn(0x7f4b5c038da0 legacy=0x7f4b5c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.025+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c09ff30 msgr2=0x7f4b7c143630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.025+0000 7f4b82290700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c09ff30 0x7f4b7c143630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4b6c002f70 tx=0x7f4b6c015000).stop 2024-04-26T07:29:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.026+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 shutdown_connections 2024-04-26T07:29:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.026+0000 7f4b82290700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b7c13c7d0 0x7f4b7c13aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.026+0000 7f4b82290700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b7c09ff30 0x7f4b7c143630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.026+0000 7f4b82290700 1 --2- 172.21.15.31:0/1356784631 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b7c137a50 0x7f4b7c064a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.026+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 >> 172.21.15.31:0/1356784631 conn(0x7f4b7c060ee0 msgr2=0x7f4b7c0a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.026+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 shutdown_connections 2024-04-26T07:29:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.026+0000 7f4b82290700 1 -- 172.21.15.31:0/1356784631 wait complete. 2024-04-26T07:29:55.036 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:29:55.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.145+0000 7f851c2f4700 1 Processor -- start 2024-04-26T07:29:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.145+0000 7f851c2f4700 1 -- start start 2024-04-26T07:29:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851c2f4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f851409c7d0 0x7f85140a2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851c2f4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f85140a3880 0x7f851413e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851c2f4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85140a2b70 con 0x7f85140a22a0 2024-04-26T07:29:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851c2f4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851409d150 con 0x7f85140a3880 2024-04-26T07:29:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851c2f4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f851409dd80 con 0x7f851409c7d0 2024-04-26T07:29:55.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851988f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f851409c7d0 0x7f85140a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851a891700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f85140a3880 0x7f851413e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851988f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f851409c7d0 0x7f85140a2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52916/0 (socket says 172.21.15.31:52916) 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851a090700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f85140a22a0 0x7f85140a3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57570/0 (socket says 172.21.15.31:57570) 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851988f700 1 -- 172.21.15.31:0/1361432394 learned_addr learned my addr 172.21.15.31:0/1361432394 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851a891700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f85140a3880 0x7f851413e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58740/0 (socket says 172.21.15.31:58740) 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851988f700 1 -- 172.21.15.31:0/1361432394 >> v2:172.21.15.31:3300/0 conn(0x7f85140a3880 msgr2=0x7f851413e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851988f700 1 --2- 172.21.15.31:0/1361432394 >> v2:172.21.15.31:3300/0 conn(0x7f85140a3880 0x7f851413e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851988f700 1 -- 172.21.15.31:0/1361432394 >> v1:172.21.15.31:6789/0 conn(0x7f85140a22a0 legacy=0x7f85140a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851988f700 1 -- 172.21.15.31:0/1361432394 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851409cbf0 con 0x7f851409c7d0 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851908e700 1 -- 172.21.15.31:0/1361432394 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632834676 0 0) 0x7f8504001110 con 0x7f85140a22a0 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851a891700 1 --2- 172.21.15.31:0/1361432394 >> v2:172.21.15.31:3300/0 conn(0x7f85140a3880 0x7f851413e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.146+0000 7f851988f700 1 --2- 172.21.15.31:0/1361432394 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f851409c7d0 0x7f85140a2680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f8510002f70 tx=0x7f8510006eb0).ready entity=mon.2 client_cookie=8a7ad130608ea31c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851908e700 1 -- 172.21.15.31:0/1361432394 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851000d570 con 0x7f851409c7d0 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851908e700 1 -- 172.21.15.31:0/1361432394 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8510000e90 con 0x7f851409c7d0 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851908e700 1 -- 172.21.15.31:0/1361432394 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851000d8c0 con 0x7f851409c7d0 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851c2f4700 1 -- 172.21.15.31:0/1361432394 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f851409c7d0 msgr2=0x7f85140a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851c2f4700 1 --2- 172.21.15.31:0/1361432394 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f851409c7d0 0x7f85140a2680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f8510002f70 tx=0x7f8510006eb0).stop 2024-04-26T07:29:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851c2f4700 1 -- 172.21.15.31:0/1361432394 shutdown_connections 2024-04-26T07:29:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851c2f4700 1 --2- 172.21.15.31:0/1361432394 >> v2:172.21.15.31:3300/0 conn(0x7f85140a3880 0x7f851413e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851c2f4700 1 --2- 172.21.15.31:0/1361432394 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f851409c7d0 0x7f85140a2680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851c2f4700 1 -- 172.21.15.31:0/1361432394 >> 172.21.15.31:0/1361432394 conn(0x7f8514060ee0 msgr2=0x7f85140a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851c2f4700 1 -- 172.21.15.31:0/1361432394 shutdown_connections 2024-04-26T07:29:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.147+0000 7f851c2f4700 1 -- 172.21.15.31:0/1361432394 wait complete. 2024-04-26T07:29:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.148+0000 7f851c2f4700 1 Processor -- start 2024-04-26T07:29:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.148+0000 7f851c2f4700 1 -- start start 2024-04-26T07:29:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851c2f4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f851409c7d0 0x7f8514096f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851c2f4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85140a22a0 0x7f8514148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851c2f4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85140a3880 0x7f8514149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851c2f4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140985a0 con 0x7f85140a22a0 2024-04-26T07:29:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851c2f4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8514098880 con 0x7f851409c7d0 2024-04-26T07:29:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851c2f4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85140652f0 con 0x7f85140a3880 2024-04-26T07:29:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851988f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85140a22a0 0x7f8514148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a090700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f851409c7d0 0x7f8514096f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851988f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85140a22a0 0x7f8514148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58744/0 (socket says 172.21.15.31:58744) 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a090700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f851409c7d0 0x7f8514096f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46976/0 (socket says 172.21.15.31:46976) 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851988f700 1 -- 172.21.15.31:0/341604952 learned_addr learned my addr 172.21.15.31:0/341604952 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a891700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85140a3880 0x7f8514149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a891700 1 -- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f851409c7d0 msgr2=0x7f8514096f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a891700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f851409c7d0 0x7f8514096f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a891700 1 -- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85140a22a0 msgr2=0x7f8514148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a891700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85140a22a0 0x7f8514148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a891700 1 -- 172.21.15.31:0/341604952 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c00b710 con 0x7f85140a3880 2024-04-26T07:29:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851988f700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85140a22a0 0x7f8514148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851a891700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85140a3880 0x7f8514149160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f850c00e000 tx=0x7f850c00b470).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f85037fe700 1 -- 172.21.15.31:0/341604952 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f850c00db20 con 0x7f85140a3880 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f85037fe700 1 -- 172.21.15.31:0/341604952 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00dc80 con 0x7f85140a3880 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851000b1e0 con 0x7f85140a3880 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f85037fe700 1 -- 172.21.15.31:0/341604952 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f850c010440 con 0x7f85140a3880 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.149+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8514066fd0 con 0x7f85140a3880 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.150+0000 7f85037fe700 1 -- 172.21.15.31:0/341604952 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f850c0105a0 con 0x7f85140a3880 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.151+0000 7f85037fe700 1 -- 172.21.15.31:0/341604952 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f850c04b5a0 con 0x7f85140a3880 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.151+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85140989f0 con 0x7f85140a3880 2024-04-26T07:29:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.154+0000 7f85037fe700 1 -- 172.21.15.31:0/341604952 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f850c014020 con 0x7f85140a3880 2024-04-26T07:29:55.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.271+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f851409ce90 con 0x7f85140a3880 2024-04-26T07:29:55.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.271+0000 7f85037fe700 1 -- 172.21.15.31:0/341604952 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f850c014030 con 0x7f85140a3880 2024-04-26T07:29:55.272 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:29:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 >> v1:172.21.15.31:6816/39613 conn(0x7f84f4038da0 legacy=0x7f84f403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85140a3880 msgr2=0x7f8514149160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85140a3880 0x7f8514149160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f850c00e000 tx=0x7f850c00b470).stop 2024-04-26T07:29:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 shutdown_connections 2024-04-26T07:29:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85140a3880 0x7f8514149160 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f851409c7d0 0x7f8514096f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 --2- 172.21.15.31:0/341604952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85140a22a0 0x7f8514148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 >> 172.21.15.31:0/341604952 conn(0x7f8514060ee0 msgr2=0x7f85140a5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 shutdown_connections 2024-04-26T07:29:55.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.272+0000 7f851c2f4700 1 -- 172.21.15.31:0/341604952 wait complete. 2024-04-26T07:29:55.283 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T07:29:55.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.391+0000 7f9ca744e700 1 Processor -- start 2024-04-26T07:29:55.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca744e700 1 -- start start 2024-04-26T07:29:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca744e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca0137e30 0x7f9ca00a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca744e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca00a3740 0x7f9ca013e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca744e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca0137620 con 0x7f9ca0137a50 2024-04-26T07:29:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca744e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00a4e20 con 0x7f9ca0137e30 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca744e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0138250 con 0x7f9ca00a3740 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca59eb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca00a3740 0x7f9ca013e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca49e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca0137e30 0x7f9ca00a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca51ea700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9ca0137a50 0x7f9ca009ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57572/0 (socket says 172.21.15.31:57572) 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.392+0000 7f9ca51ea700 1 -- 172.21.15.31:0/1217882341 learned_addr learned my addr 172.21.15.31:0/1217882341 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9ca59eb700 1 -- 172.21.15.31:0/1217882341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca0137e30 msgr2=0x7f9ca00a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9ca59eb700 1 --2- 172.21.15.31:0/1217882341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca0137e30 0x7f9ca00a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9c8ffff700 1 -- 172.21.15.31:0/1217882341 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416398020 0 0) 0x7f9ca0137620 con 0x7f9ca0137a50 2024-04-26T07:29:55.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9ca59eb700 1 -- 172.21.15.31:0/1217882341 >> v1:172.21.15.31:6789/0 conn(0x7f9ca0137a50 legacy=0x7f9ca009ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9ca59eb700 1 -- 172.21.15.31:0/1217882341 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00a46a0 con 0x7f9ca00a3740 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9ca59eb700 1 --2- 172.21.15.31:0/1217882341 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca00a3740 0x7f9ca013e7e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f9c980032f0 tx=0x7f9c980091d0).ready entity=mon.2 client_cookie=130e3a724a05d1cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9c8ffff700 1 -- 172.21.15.31:0/1217882341 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c9800b660 con 0x7f9ca00a3740 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9c8ffff700 1 -- 172.21.15.31:0/1217882341 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9800b7c0 con 0x7f9ca00a3740 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9c8ffff700 1 -- 172.21.15.31:0/1217882341 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c9800b930 con 0x7f9ca00a3740 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9ca744e700 1 -- 172.21.15.31:0/1217882341 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca00a3740 msgr2=0x7f9ca013e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.393+0000 7f9ca744e700 1 --2- 172.21.15.31:0/1217882341 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca00a3740 0x7f9ca013e7e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f9c980032f0 tx=0x7f9c980091d0).stop 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.394+0000 7f9ca744e700 1 -- 172.21.15.31:0/1217882341 shutdown_connections 2024-04-26T07:29:55.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.394+0000 7f9ca744e700 1 --2- 172.21.15.31:0/1217882341 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca00a3740 0x7f9ca013e7e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.394+0000 7f9ca744e700 1 --2- 172.21.15.31:0/1217882341 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca0137e30 0x7f9ca00a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.394+0000 7f9ca744e700 1 -- 172.21.15.31:0/1217882341 >> 172.21.15.31:0/1217882341 conn(0x7f9ca0060ee0 msgr2=0x7f9ca00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.394+0000 7f9ca744e700 1 -- 172.21.15.31:0/1217882341 shutdown_connections 2024-04-26T07:29:55.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.394+0000 7f9ca744e700 1 -- 172.21.15.31:0/1217882341 wait complete. 2024-04-26T07:29:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.394+0000 7f9ca744e700 1 Processor -- start 2024-04-26T07:29:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.394+0000 7f9ca744e700 1 -- start start 2024-04-26T07:29:55.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca744e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca00a3740 0x7f9ca009d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca744e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ca0137a50 0x7f9ca0065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca744e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca0137e30 0x7f9ca00664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca744e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00a2ae0 con 0x7f9ca0137a50 2024-04-26T07:29:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca744e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca009e2b0 con 0x7f9ca00a3740 2024-04-26T07:29:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca744e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca009dbf0 con 0x7f9ca0137e30 2024-04-26T07:29:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca51ea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca00a3740 0x7f9ca009d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca49e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ca0137a50 0x7f9ca0065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca49e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ca0137a50 0x7f9ca0065ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58760/0 (socket says 172.21.15.31:58760) 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca51ea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca00a3740 0x7f9ca009d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47002/0 (socket says 172.21.15.31:47002) 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca49e9700 1 -- 172.21.15.31:0/3248563587 learned_addr learned my addr 172.21.15.31:0/3248563587 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca59eb700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca0137e30 0x7f9ca00664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca51ea700 1 -- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca0137e30 msgr2=0x7f9ca00664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca51ea700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca0137e30 0x7f9ca00664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca51ea700 1 -- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ca0137a50 msgr2=0x7f9ca0065ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.395+0000 7f9ca51ea700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ca0137a50 0x7f9ca0065ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9ca51ea700 1 -- 172.21.15.31:0/3248563587 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98009470 con 0x7f9ca00a3740 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9ca59eb700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca0137e30 0x7f9ca00664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9ca49e9700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ca0137a50 0x7f9ca0065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9ca51ea700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca00a3740 0x7f9ca009d220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9c90000bc0 tx=0x7f9c900079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9c8e7fc700 1 -- 172.21.15.31:0/3248563587 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c9000ce00 con 0x7f9ca00a3740 2024-04-26T07:29:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9c8e7fc700 1 -- 172.21.15.31:0/3248563587 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c900070d0 con 0x7f9ca00a3740 2024-04-26T07:29:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9c8e7fc700 1 -- 172.21.15.31:0/3248563587 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c90007430 con 0x7f9ca00a3740 2024-04-26T07:29:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca0065ba0 con 0x7f9ca00a3740 2024-04-26T07:29:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.396+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca00a1ed0 con 0x7f9ca00a3740 2024-04-26T07:29:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.397+0000 7f9c8e7fc700 1 -- 172.21.15.31:0/3248563587 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9c90010070 con 0x7f9ca00a3740 2024-04-26T07:29:55.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.397+0000 7f9c8e7fc700 1 -- 172.21.15.31:0/3248563587 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9c90049d00 con 0x7f9ca00a3740 2024-04-26T07:29:55.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.397+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca009d070 con 0x7f9ca00a3740 2024-04-26T07:29:55.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.400+0000 7f9c8e7fc700 1 -- 172.21.15.31:0/3248563587 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9c90018020 con 0x7f9ca00a3740 2024-04-26T07:29:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.517+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ca005e330 con 0x7f9ca00a3740 2024-04-26T07:29:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.517+0000 7f9c8e7fc700 1 -- 172.21.15.31:0/3248563587 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c90018070 con 0x7f9ca00a3740 2024-04-26T07:29:55.518 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-26T07:29:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 >> v1:172.21.15.31:6816/39613 conn(0x7f9c80038e30 legacy=0x7f9c8003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca00a3740 msgr2=0x7f9ca009d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca00a3740 0x7f9ca009d220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9c90000bc0 tx=0x7f9c900079e0).stop 2024-04-26T07:29:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 shutdown_connections 2024-04-26T07:29:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9ca0137e30 0x7f9ca00664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9ca00a3740 0x7f9ca009d220 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 --2- 172.21.15.31:0/3248563587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ca0137a50 0x7f9ca0065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 >> 172.21.15.31:0/3248563587 conn(0x7f9ca0060ee0 msgr2=0x7f9ca00a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 shutdown_connections 2024-04-26T07:29:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.519+0000 7f9ca744e700 1 -- 172.21.15.31:0/3248563587 wait complete. 2024-04-26T07:29:55.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T07:29:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.638+0000 7f4b9dddc700 1 Processor -- start 2024-04-26T07:29:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.638+0000 7f4b9dddc700 1 -- start start 2024-04-26T07:29:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b9dddc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b980a3170 0x7f4b9809e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b9dddc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b9809c9e0 0x7f4b980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b9dddc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b9809f420 0x7f4b980a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b9dddc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9809e2a0 con 0x7f4b9809c9e0 2024-04-26T07:29:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b9dddc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9809ce70 con 0x7f4b9809f420 2024-04-26T07:29:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b9dddc700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9809d110 con 0x7f4b980a3170 2024-04-26T07:29:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b97fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b9809f420 0x7f4b980a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b96ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b9809c9e0 0x7f4b980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b97fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b9809f420 0x7f4b980a3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47006/0 (socket says 172.21.15.31:47006) 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b97fff700 1 -- 172.21.15.31:0/1448106897 learned_addr learned my addr 172.21.15.31:0/1448106897 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b977fe700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b980a3170 0x7f4b9809e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b96ffd700 1 -- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b980a3170 msgr2=0x7f4b9809e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b96ffd700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b980a3170 0x7f4b9809e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b96ffd700 1 -- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b9809f420 msgr2=0x7f4b980a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b96ffd700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b9809f420 0x7f4b980a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b96ffd700 1 -- 172.21.15.31:0/1448106897 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980a3f30 con 0x7f4b9809c9e0 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.639+0000 7f4b97fff700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b9809f420 0x7f4b980a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b96ffd700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809c9e0 0x7f4b980a3550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f4b98067820 tx=0x7f4b80006df0).ready entity=mon.0 client_cookie=5e09c2a7ad6fa39f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b967fc700 1 -- 172.21.15.31:0/1448106897 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8000d4a0 con 0x7f4b9809c9e0 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b967fc700 1 -- 172.21.15.31:0/1448106897 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80000e90 con 0x7f4b9809c9e0 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b967fc700 1 -- 172.21.15.31:0/1448106897 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8000d7f0 con 0x7f4b9809c9e0 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 -- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809c9e0 msgr2=0x7f4b980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809c9e0 0x7f4b980a3550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f4b98067820 tx=0x7f4b80006df0).stop 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 -- 172.21.15.31:0/1448106897 shutdown_connections 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b9809f420 0x7f4b980a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b980a3170 0x7f4b9809e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 --2- 172.21.15.31:0/1448106897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809c9e0 0x7f4b980a3550 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 -- 172.21.15.31:0/1448106897 >> 172.21.15.31:0/1448106897 conn(0x7f4b98060ee0 msgr2=0x7f4b980a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 -- 172.21.15.31:0/1448106897 shutdown_connections 2024-04-26T07:29:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.640+0000 7f4b9dddc700 1 -- 172.21.15.31:0/1448106897 wait complete. 2024-04-26T07:29:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.641+0000 7f4b9dddc700 1 Processor -- start 2024-04-26T07:29:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.641+0000 7f4b9dddc700 1 -- start start 2024-04-26T07:29:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b9dddc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809f420 0x7f4b9813c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b9dddc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b980a3170 0x7f4b98146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b9dddc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b9813cb20 0x7f4b98146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b9dddc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98139b20 con 0x7f4b9809f420 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b9dddc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980618c0 con 0x7f4b980a3170 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b9dddc700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9813d000 con 0x7f4b9813cb20 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b977fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809f420 0x7f4b9813c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b977fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809f420 0x7f4b9813c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58772/0 (socket says 172.21.15.31:58772) 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b977fe700 1 -- 172.21.15.31:0/458957703 learned_addr learned my addr 172.21.15.31:0/458957703 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b97fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b9813cb20 0x7f4b98146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b96ffd700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b980a3170 0x7f4b98146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b977fe700 1 -- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b9813cb20 msgr2=0x7f4b98146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b977fe700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b9813cb20 0x7f4b98146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b977fe700 1 -- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b980a3170 msgr2=0x7f4b98146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b977fe700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b980a3170 0x7f4b98146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b977fe700 1 -- 172.21.15.31:0/458957703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90009530 con 0x7f4b9809f420 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.642+0000 7f4b97fff700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b9813cb20 0x7f4b98146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.643+0000 7f4b977fe700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809f420 0x7f4b9813c630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f4b8800c000 tx=0x7f4b88006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.643+0000 7f4b94ff9700 1 -- 172.21.15.31:0/458957703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b88011750 con 0x7f4b9809f420 2024-04-26T07:29:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.643+0000 7f4b94ff9700 1 -- 172.21.15.31:0/458957703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880118b0 con 0x7f4b9809f420 2024-04-26T07:29:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.643+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8000b180 con 0x7f4b9809f420 2024-04-26T07:29:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.643+0000 7f4b94ff9700 1 -- 172.21.15.31:0/458957703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b88011c10 con 0x7f4b9809f420 2024-04-26T07:29:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.643+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9813c190 con 0x7f4b9809f420 2024-04-26T07:29:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.644+0000 7f4b94ff9700 1 -- 172.21.15.31:0/458957703 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4b88011d70 con 0x7f4b9809f420 2024-04-26T07:29:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.644+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9805c4e0 con 0x7f4b9809f420 2024-04-26T07:29:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.644+0000 7f4b94ff9700 1 -- 172.21.15.31:0/458957703 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4b8804ace0 con 0x7f4b9809f420 2024-04-26T07:29:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.647+0000 7f4b94ff9700 1 -- 172.21.15.31:0/458957703 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4b88033570 con 0x7f4b9809f420 2024-04-26T07:29:55.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.764+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b9806bbc0 con 0x7f4b9809f420 2024-04-26T07:29:55.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.764+0000 7f4b94ff9700 1 -- 172.21.15.31:0/458957703 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b88033160 con 0x7f4b9809f420 2024-04-26T07:29:55.765 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-26T07:29:55.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 >> v1:172.21.15.31:6816/39613 conn(0x7f4b7c038da0 legacy=0x7f4b7c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809f420 msgr2=0x7f4b9813c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809f420 0x7f4b9813c630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f4b8800c000 tx=0x7f4b88006df0).stop 2024-04-26T07:29:55.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 shutdown_connections 2024-04-26T07:29:55.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4b9813cb20 0x7f4b98146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b9809f420 0x7f4b9813c630 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 --2- 172.21.15.31:0/458957703 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b980a3170 0x7f4b98146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 >> 172.21.15.31:0/458957703 conn(0x7f4b98060ee0 msgr2=0x7f4b980a3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:55.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 shutdown_connections 2024-04-26T07:29:55.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.766+0000 7f4b9dddc700 1 -- 172.21.15.31:0/458957703 wait complete. 2024-04-26T07:29:55.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T07:29:55.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.884+0000 7f295467b700 1 Processor -- start 2024-04-26T07:29:55.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.884+0000 7f295467b700 1 -- start start 2024-04-26T07:29:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f295467b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c0679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f295467b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f294c1339b0 0x7f294c0a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f295467b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c05b970 0x7f294c05be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f295467b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c067ec0 con 0x7f294c1339b0 2024-04-26T07:29:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f295467b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0670c0 con 0x7f294c05b970 2024-04-26T07:29:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f295467b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f294c066600 con 0x7f294c1335d0 2024-04-26T07:29:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2952c18700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c05b970 0x7f294c05be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2952417700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c0679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2951c16700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f294c1339b0 0x7f294c0a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2952417700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c0679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52962/0 (socket says 172.21.15.31:52962) 2024-04-26T07:29:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2952c18700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c05b970 0x7f294c05be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47036/0 (socket says 172.21.15.31:47036) 2024-04-26T07:29:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2952417700 1 -- 172.21.15.31:0/2440360955 learned_addr learned my addr 172.21.15.31:0/2440360955 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2951c16700 1 -- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 msgr2=0x7f294c0679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2951c16700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c0679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2951c16700 1 -- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c05b970 msgr2=0x7f294c05be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2951c16700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c05b970 0x7f294c05be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2951c16700 1 -- 172.21.15.31:0/2440360955 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c066de0 con 0x7f294c1339b0 2024-04-26T07:29:55.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2952417700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c0679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.885+0000 7f2952c18700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c05b970 0x7f294c05be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f2951c16700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f294c1339b0 0x7f294c0a43e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2948002f70 tx=0x7f2948006df0).ready entity=mon.0 client_cookie=5e3e2b458e1ebb81 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:55.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f2951415700 1 -- 172.21.15.31:0/2440360955 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294800d4a0 con 0x7f294c1339b0 2024-04-26T07:29:55.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f2951415700 1 -- 172.21.15.31:0/2440360955 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948000e90 con 0x7f294c1339b0 2024-04-26T07:29:55.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f2951415700 1 -- 172.21.15.31:0/2440360955 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294800d7f0 con 0x7f294c1339b0 2024-04-26T07:29:55.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 -- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f294c1339b0 msgr2=0x7f294c0a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f294c1339b0 0x7f294c0a43e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2948002f70 tx=0x7f2948006df0).stop 2024-04-26T07:29:55.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 -- 172.21.15.31:0/2440360955 shutdown_connections 2024-04-26T07:29:55.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c05b970 0x7f294c05be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c0679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 --2- 172.21.15.31:0/2440360955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f294c1339b0 0x7f294c0a43e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 -- 172.21.15.31:0/2440360955 >> 172.21.15.31:0/2440360955 conn(0x7f294c060ee0 msgr2=0x7f294c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:55.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 -- 172.21.15.31:0/2440360955 shutdown_connections 2024-04-26T07:29:55.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.886+0000 7f295467b700 1 -- 172.21.15.31:0/2440360955 wait complete. 2024-04-26T07:29:55.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.887+0000 7f295467b700 1 Processor -- start 2024-04-26T07:29:55.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.887+0000 7f295467b700 1 -- start start 2024-04-26T07:29:55.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f295467b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f294c05b970 0x7f294c1459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f295467b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f295467b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c1339b0 0x7f294c149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:55.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f295467b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c138b40 con 0x7f294c05b970 2024-04-26T07:29:55.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f295467b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c138930 con 0x7f294c1339b0 2024-04-26T07:29:55.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f295467b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f294c145ed0 con 0x7f294c1335d0 2024-04-26T07:29:55.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f294c05b970 0x7f294c1459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f294c05b970 0x7f294c1459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58798/0 (socket says 172.21.15.31:58798) 2024-04-26T07:29:55.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 -- 172.21.15.31:0/780171014 learned_addr learned my addr 172.21.15.31:0/780171014 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:55.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952c18700 1 --2- 172.21.15.31:0/780171014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c1339b0 0x7f294c149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2951c16700 1 --2- 172.21.15.31:0/780171014 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:55.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 -- 172.21.15.31:0/780171014 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 msgr2=0x7f294c148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 --2- 172.21.15.31:0/780171014 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f294c1335d0 0x7f294c148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 -- 172.21.15.31:0/780171014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c1339b0 msgr2=0x7f294c149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:55.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 --2- 172.21.15.31:0/780171014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c1339b0 0x7f294c149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:55.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 -- 172.21.15.31:0/780171014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944009470 con 0x7f294c05b970 2024-04-26T07:29:55.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952c18700 1 --2- 172.21.15.31:0/780171014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f294c1339b0 0x7f294c149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:55.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f2952417700 1 --2- 172.21.15.31:0/780171014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f294c05b970 0x7f294c1459e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f294c1390c0 tx=0x7f293c006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:55.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f293b7fe700 1 -- 172.21.15.31:0/780171014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293c00c5e0 con 0x7f294c05b970 2024-04-26T07:29:55.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.888+0000 7f293b7fe700 1 -- 172.21.15.31:0/780171014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c00c740 con 0x7f294c05b970 2024-04-26T07:29:55.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.889+0000 7f295467b700 1 -- 172.21.15.31:0/780171014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c00b1e0 con 0x7f294c05b970 2024-04-26T07:29:55.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.889+0000 7f293b7fe700 1 -- 172.21.15.31:0/780171014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293c00caa0 con 0x7f294c05b970 2024-04-26T07:29:55.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.889+0000 7f295467b700 1 -- 172.21.15.31:0/780171014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294800b180 con 0x7f294c05b970 2024-04-26T07:29:55.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.889+0000 7f293b7fe700 1 -- 172.21.15.31:0/780171014 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f293c022070 con 0x7f294c05b970 2024-04-26T07:29:55.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.890+0000 7f293b7fe700 1 -- 172.21.15.31:0/780171014 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f293c04adb0 con 0x7f294c05b970 2024-04-26T07:29:55.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.890+0000 7f295467b700 1 -- 172.21.15.31:0/780171014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c065ba0 con 0x7f294c05b970 2024-04-26T07:29:55.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:55.893+0000 7f293b7fe700 1 -- 172.21.15.31:0/780171014 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f293c0336e0 con 0x7f294c05b970 2024-04-26T07:29:56.052 INFO:teuthology.orchestra.run.smithi031.stderr:no valid command found; 10 closest matches: 2024-04-26T07:29:56.052 INFO:teuthology.orchestra.run.smithi031.stderr:osd perf 2024-04-26T07:29:56.052 INFO:teuthology.orchestra.run.smithi031.stderr:osd df [plain|tree] [class|name] [] 2024-04-26T07:29:56.052 INFO:teuthology.orchestra.run.smithi031.stderr:osd blocked-by 2024-04-26T07:29:56.052 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool stats [] 2024-04-26T07:29:56.053 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool scrub ... 2024-04-26T07:29:56.053 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool deep-scrub ... 2024-04-26T07:29:56.053 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool repair ... 2024-04-26T07:29:56.053 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool force-recovery ... 2024-04-26T07:29:56.053 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool force-backfill ... 2024-04-26T07:29:56.053 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool cancel-force-recovery ... 2024-04-26T07:29:56.053 INFO:teuthology.orchestra.run.smithi031.stderr:Error EINVAL: invalid command 2024-04-26T07:29:56.054 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T07:29:56.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-04-26T07:29:56.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.162+0000 7f40e76d8700 1 Processor -- start 2024-04-26T07:29:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.162+0000 7f40e76d8700 1 -- start start 2024-04-26T07:29:56.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e76d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e0096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e76d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e005c080 0x7f40e0141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e76d8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e00970a0 con 0x7f40e006c7d0 2024-04-26T07:29:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e76d8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0133c10 con 0x7f40e01360f0 2024-04-26T07:29:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e76d8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0096810 con 0x7f40e005c080 2024-04-26T07:29:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e5c75700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e005c080 0x7f40e0141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e4c73700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e0096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e5c75700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e005c080 0x7f40e0141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52988/0 (socket says 172.21.15.31:52988) 2024-04-26T07:29:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e5474700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f40e006c7d0 0x7f40e005b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57586/0 (socket says 172.21.15.31:57586) 2024-04-26T07:29:56.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e5c75700 1 -- 172.21.15.31:0/3339824095 learned_addr learned my addr 172.21.15.31:0/3339824095 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:56.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e5c75700 1 -- 172.21.15.31:0/3339824095 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 msgr2=0x7f40e0096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:56.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e5c75700 1 --2- 172.21.15.31:0/3339824095 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e0096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40cffff700 1 -- 172.21.15.31:0/3339824095 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7990135 0 0) 0x7f40e00970a0 con 0x7f40e006c7d0 2024-04-26T07:29:56.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e5c75700 1 -- 172.21.15.31:0/3339824095 >> v1:172.21.15.31:6789/0 conn(0x7f40e006c7d0 legacy=0x7f40e005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e5c75700 1 -- 172.21.15.31:0/3339824095 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e01364d0 con 0x7f40e005c080 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.163+0000 7f40e4c73700 1 --2- 172.21.15.31:0/3339824095 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e0096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e5c75700 1 --2- 172.21.15.31:0/3339824095 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e005c080 0x7f40e0141a50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f40d80032f0 tx=0x7f40d8009290).ready entity=mon.2 client_cookie=5fefb1a86333fd36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40cffff700 1 -- 172.21.15.31:0/3339824095 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40d800b840 con 0x7f40e005c080 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40cffff700 1 -- 172.21.15.31:0/3339824095 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d800b9a0 con 0x7f40e005c080 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40cffff700 1 -- 172.21.15.31:0/3339824095 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40d800bb10 con 0x7f40e005c080 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e76d8700 1 -- 172.21.15.31:0/3339824095 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e005c080 msgr2=0x7f40e0141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e76d8700 1 --2- 172.21.15.31:0/3339824095 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e005c080 0x7f40e0141a50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f40d80032f0 tx=0x7f40d8009290).stop 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e76d8700 1 -- 172.21.15.31:0/3339824095 shutdown_connections 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e76d8700 1 --2- 172.21.15.31:0/3339824095 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e005c080 0x7f40e0141a50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e76d8700 1 --2- 172.21.15.31:0/3339824095 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e0096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e76d8700 1 -- 172.21.15.31:0/3339824095 >> 172.21.15.31:0/3339824095 conn(0x7f40e0061370 msgr2=0x7f40e006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:56.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e76d8700 1 -- 172.21.15.31:0/3339824095 shutdown_connections 2024-04-26T07:29:56.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.164+0000 7f40e76d8700 1 -- 172.21.15.31:0/3339824095 wait complete. 2024-04-26T07:29:56.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.165+0000 7f40e76d8700 1 Processor -- start 2024-04-26T07:29:56.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.165+0000 7f40e76d8700 1 -- start start 2024-04-26T07:29:56.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e76d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e005c080 0x7f40e009d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e76d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e006c7d0 0x7f40e0066fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e76d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e01460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e76d8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e009cee0 con 0x7f40e005c080 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e76d8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0065d20 con 0x7f40e01360f0 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e76d8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0145de0 con 0x7f40e006c7d0 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e006c7d0 0x7f40e0066fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e5474700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e005c080 0x7f40e009d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e006c7d0 0x7f40e0066fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52998/0 (socket says 172.21.15.31:52998) 2024-04-26T07:29:56.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 -- 172.21.15.31:0/2594323110 learned_addr learned my addr 172.21.15.31:0/2594323110 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:56.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e5c75700 1 --2- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e01460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 -- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 msgr2=0x7f40e01460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 --2- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e01460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 -- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e005c080 msgr2=0x7f40e009d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 --2- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e005c080 0x7f40e009d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 -- 172.21.15.31:0/2594323110 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc00b180 con 0x7f40e006c7d0 2024-04-26T07:29:56.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.166+0000 7f40e4c73700 1 --2- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e006c7d0 0x7f40e0066fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f40dc00c000 tx=0x7f40dc006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:56.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.167+0000 7f40ce7fc700 1 -- 172.21.15.31:0/2594323110 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40dc010780 con 0x7f40e006c7d0 2024-04-26T07:29:56.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.167+0000 7f40ce7fc700 1 -- 172.21.15.31:0/2594323110 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0108e0 con 0x7f40e006c7d0 2024-04-26T07:29:56.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.167+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d8009530 con 0x7f40e006c7d0 2024-04-26T07:29:56.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.167+0000 7f40ce7fc700 1 -- 172.21.15.31:0/2594323110 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40dc010c40 con 0x7f40e006c7d0 2024-04-26T07:29:56.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.167+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e0067ff0 con 0x7f40e006c7d0 2024-04-26T07:29:56.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.168+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e0068240 con 0x7f40e006c7d0 2024-04-26T07:29:56.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.168+0000 7f40ce7fc700 1 -- 172.21.15.31:0/2594323110 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f40dc01c460 con 0x7f40e006c7d0 2024-04-26T07:29:56.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.168+0000 7f40ce7fc700 1 -- 172.21.15.31:0/2594323110 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f40dc04ad90 con 0x7f40e006c7d0 2024-04-26T07:29:56.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.171+0000 7f40ce7fc700 1 -- 172.21.15.31:0/2594323110 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f40dc0336c0 con 0x7f40e006c7d0 2024-04-26T07:29:56.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.302+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) v1 -- 0x7f40e0136780 con 0x7f40e006c7d0 2024-04-26T07:29:56.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.302+0000 7f40ce7fc700 1 -- 172.21.15.31:0/2594323110 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v19) v1 ==== 80+0+0 (secure 0 0 0) 0x7f40dc0332b0 con 0x7f40e006c7d0 2024-04-26T07:29:56.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 >> v1:172.21.15.31:6816/39613 conn(0x7f40c0038e30 legacy=0x7f40c003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e006c7d0 msgr2=0x7f40e0066fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 --2- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e006c7d0 0x7f40e0066fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f40dc00c000 tx=0x7f40dc006df0).stop 2024-04-26T07:29:56.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 shutdown_connections 2024-04-26T07:29:56.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 --2- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40e01360f0 0x7f40e01460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 --2- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e005c080 0x7f40e009d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 --2- 172.21.15.31:0/2594323110 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40e006c7d0 0x7f40e0066fd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 >> 172.21.15.31:0/2594323110 conn(0x7f40e0061370 msgr2=0x7f40e009ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:56.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 shutdown_connections 2024-04-26T07:29:56.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.303+0000 7f40e76d8700 1 -- 172.21.15.31:0/2594323110 wait complete. 2024-04-26T07:29:56.305 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-04-26T07:29:56.314 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-26T07:29:56.314 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T07:29:56.337 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:29:56.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.443+0000 7fbc7f500700 1 Processor -- start 2024-04-26T07:29:56.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7f500700 1 -- start start 2024-04-26T07:29:56.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7f500700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc7809a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7f500700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78136d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7f500700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7809b670 con 0x7fbc7809bc70 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7f500700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781361b0 con 0x7fbc78067500 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7f500700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7809b400 con 0x7fbc7809c070 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7d29c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc7809a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7ca9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbc7809bc70 0x7fbc78136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57592/0 (socket says 172.21.15.31:57592) 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7ca9b700 1 -- 172.21.15.31:0/3590498253 learned_addr learned my addr 172.21.15.31:0/3590498253 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.444+0000 7fbc7da9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7d29c700 1 -- 172.21.15.31:0/3590498253 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 msgr2=0x7fbc78136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:56.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7d29c700 1 --2- 172.21.15.31:0/3590498253 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc6bfff700 1 -- 172.21.15.31:0/3590498253 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619474714 0 0) 0x7fbc7809b670 con 0x7fbc7809bc70 2024-04-26T07:29:56.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7d29c700 1 -- 172.21.15.31:0/3590498253 >> v1:172.21.15.31:6789/0 conn(0x7fbc7809bc70 legacy=0x7fbc78136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7d29c700 1 -- 172.21.15.31:0/3590498253 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc781363a0 con 0x7fbc78067500 2024-04-26T07:29:56.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7da9d700 1 --2- 172.21.15.31:0/3590498253 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7d29c700 1 --2- 172.21.15.31:0/3590498253 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc7809a8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fbc6c002f70 tx=0x7fbc6c006df0).ready entity=mon.1 client_cookie=35472e91d368e627 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:56.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc6bfff700 1 -- 172.21.15.31:0/3590498253 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6c00d570 con 0x7fbc78067500 2024-04-26T07:29:56.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc6bfff700 1 -- 172.21.15.31:0/3590498253 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c000e90 con 0x7fbc78067500 2024-04-26T07:29:56.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc6bfff700 1 -- 172.21.15.31:0/3590498253 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6c00d8c0 con 0x7fbc78067500 2024-04-26T07:29:56.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7f500700 1 -- 172.21.15.31:0/3590498253 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 msgr2=0x7fbc7809a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7f500700 1 --2- 172.21.15.31:0/3590498253 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc7809a8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fbc6c002f70 tx=0x7fbc6c006df0).stop 2024-04-26T07:29:56.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7f500700 1 -- 172.21.15.31:0/3590498253 shutdown_connections 2024-04-26T07:29:56.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7f500700 1 --2- 172.21.15.31:0/3590498253 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7f500700 1 --2- 172.21.15.31:0/3590498253 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc7809a8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.445+0000 7fbc7f500700 1 -- 172.21.15.31:0/3590498253 >> 172.21.15.31:0/3590498253 conn(0x7fbc7805cfb0 msgr2=0x7fbc78062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:56.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.446+0000 7fbc7f500700 1 -- 172.21.15.31:0/3590498253 shutdown_connections 2024-04-26T07:29:56.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.446+0000 7fbc7f500700 1 -- 172.21.15.31:0/3590498253 wait complete. 2024-04-26T07:29:56.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.446+0000 7fbc7f500700 1 Processor -- start 2024-04-26T07:29:56.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.446+0000 7fbc7f500700 1 -- start start 2024-04-26T07:29:56.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7f500700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc780a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7f500700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc7809bc70 0x7fbc78145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7f500700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78134050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7f500700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78146490 con 0x7fbc7809bc70 2024-04-26T07:29:56.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7f500700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781461d0 con 0x7fbc78067500 2024-04-26T07:29:56.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7f500700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78091f10 con 0x7fbc7809c070 2024-04-26T07:29:56.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7d29c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc780a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7d29c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc780a9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47088/0 (socket says 172.21.15.31:47088) 2024-04-26T07:29:56.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7da9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7d29c700 1 -- 172.21.15.31:0/4219137706 learned_addr learned my addr 172.21.15.31:0/4219137706 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7ca9b700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc7809bc70 0x7fbc78145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7d29c700 1 -- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 msgr2=0x7fbc78134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7d29c700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78134050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7d29c700 1 -- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc7809bc70 msgr2=0x7fbc78145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7d29c700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc7809bc70 0x7fbc78145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.447+0000 7fbc7d29c700 1 -- 172.21.15.31:0/4219137706 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc70009470 con 0x7fbc78067500 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.448+0000 7fbc7da9d700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78134050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.448+0000 7fbc7d29c700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc780a9310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbc6c002f70 tx=0x7fbc6c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:56.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.448+0000 7fbc6a7fc700 1 -- 172.21.15.31:0/4219137706 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6c016070 con 0x7fbc78067500 2024-04-26T07:29:56.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.448+0000 7fbc6a7fc700 1 -- 172.21.15.31:0/4219137706 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c013c60 con 0x7fbc78067500 2024-04-26T07:29:56.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.448+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c00b180 con 0x7fbc78067500 2024-04-26T07:29:56.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.448+0000 7fbc6a7fc700 1 -- 172.21.15.31:0/4219137706 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6c00dea0 con 0x7fbc78067500 2024-04-26T07:29:56.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.448+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc78095090 con 0x7fbc78067500 2024-04-26T07:29:56.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.449+0000 7fbc6a7fc700 1 -- 172.21.15.31:0/4219137706 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbc6c025030 con 0x7fbc78067500 2024-04-26T07:29:56.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.449+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc78067960 con 0x7fbc78067500 2024-04-26T07:29:56.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.449+0000 7fbc6a7fc700 1 -- 172.21.15.31:0/4219137706 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbc6c04b920 con 0x7fbc78067500 2024-04-26T07:29:56.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.452+0000 7fbc6a7fc700 1 -- 172.21.15.31:0/4219137706 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbc6c028610 con 0x7fbc78067500 2024-04-26T07:29:56.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.569+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc78062b20 con 0x7fbc78067500 2024-04-26T07:29:56.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.570+0000 7fbc6a7fc700 1 -- 172.21.15.31:0/4219137706 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7fbc6c023030 con 0x7fbc78067500 2024-04-26T07:29:56.570 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:29:56.571 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:45.886508+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:29:56.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.571+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 >> v1:172.21.15.31:6816/39613 conn(0x7fbc58038ec0 legacy=0x7fbc5803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.571+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 msgr2=0x7fbc780a9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.571+0000 7fbc7f500700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc780a9310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbc6c002f70 tx=0x7fbc6c014000).stop 2024-04-26T07:29:56.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.572+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 shutdown_connections 2024-04-26T07:29:56.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.572+0000 7fbc7f500700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbc7809c070 0x7fbc78134050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.572+0000 7fbc7f500700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbc78067500 0x7fbc780a9310 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.572+0000 7fbc7f500700 1 --2- 172.21.15.31:0/4219137706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc7809bc70 0x7fbc78145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.572+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 >> 172.21.15.31:0/4219137706 conn(0x7fbc7805cfb0 msgr2=0x7fbc78132c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:56.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.572+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 shutdown_connections 2024-04-26T07:29:56.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.572+0000 7fbc7f500700 1 -- 172.21.15.31:0/4219137706 wait complete. 2024-04-26T07:29:56.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-26T07:28:14.020617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:28:20.865140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T07:28:28.939656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T07:28:30.129744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T07:29:56.583 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-26T07:29:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.691+0000 7f68d3685700 1 Processor -- start 2024-04-26T07:29:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.691+0000 7f68d3685700 1 -- start start 2024-04-26T07:29:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d3685700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc065870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d3685700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68cc1374d0 0x7f68cc0a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d3685700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc064f90 con 0x7f68cc0a9980 2024-04-26T07:29:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d3685700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc065420 con 0x7f68cc1374d0 2024-04-26T07:29:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d3685700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc137960 con 0x7f68cc0a8380 2024-04-26T07:29:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d1421700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d0c20700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68cc1374d0 0x7f68cc0a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d1421700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc065870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47092/0 (socket says 172.21.15.31:47092) 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d0c20700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68cc1374d0 0x7f68cc0a8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58822/0 (socket says 172.21.15.31:58822) 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d1421700 1 -- 172.21.15.31:0/281451056 learned_addr learned my addr 172.21.15.31:0/281451056 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d0c20700 1 -- 172.21.15.31:0/281451056 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 msgr2=0x7f68cc065870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d0c20700 1 --2- 172.21.15.31:0/281451056 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc065870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d0c20700 1 -- 172.21.15.31:0/281451056 >> v1:172.21.15.31:6789/0 conn(0x7f68cc0a9980 legacy=0x7f68cc05b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d0c20700 1 -- 172.21.15.31:0/281451056 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc137c20 con 0x7f68cc1374d0 2024-04-26T07:29:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68bbfff700 1 -- 172.21.15.31:0/281451056 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287020130 0 0) 0x7f68cc064f90 con 0x7f68cc0a9980 2024-04-26T07:29:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.692+0000 7f68d1421700 1 --2- 172.21.15.31:0/281451056 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc065870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d0c20700 1 --2- 172.21.15.31:0/281451056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc1374d0 0x7f68cc0a8760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f68c8002f70 tx=0x7f68c8006df0).ready entity=mon.0 client_cookie=53d82fbcdcece03c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68bbfff700 1 -- 172.21.15.31:0/281451056 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c800d570 con 0x7f68cc1374d0 2024-04-26T07:29:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68bbfff700 1 -- 172.21.15.31:0/281451056 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c8000e90 con 0x7f68cc1374d0 2024-04-26T07:29:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68bbfff700 1 -- 172.21.15.31:0/281451056 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c800d8c0 con 0x7f68cc1374d0 2024-04-26T07:29:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d3685700 1 -- 172.21.15.31:0/281451056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc1374d0 msgr2=0x7f68cc0a8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d3685700 1 --2- 172.21.15.31:0/281451056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc1374d0 0x7f68cc0a8760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f68c8002f70 tx=0x7f68c8006df0).stop 2024-04-26T07:29:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d3685700 1 -- 172.21.15.31:0/281451056 shutdown_connections 2024-04-26T07:29:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d3685700 1 --2- 172.21.15.31:0/281451056 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc065870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d3685700 1 --2- 172.21.15.31:0/281451056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc1374d0 0x7f68cc0a8760 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d3685700 1 -- 172.21.15.31:0/281451056 >> 172.21.15.31:0/281451056 conn(0x7f68cc061370 msgr2=0x7f68cc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d3685700 1 -- 172.21.15.31:0/281451056 shutdown_connections 2024-04-26T07:29:56.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.693+0000 7f68d3685700 1 -- 172.21.15.31:0/281451056 wait complete. 2024-04-26T07:29:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.694+0000 7f68d3685700 1 Processor -- start 2024-04-26T07:29:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.694+0000 7f68d3685700 1 -- start start 2024-04-26T07:29:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d3685700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d3685700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f68cc0a9980 0x7f68cc130910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d3685700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc097e80 0x7f68cc130e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d3685700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc098580 con 0x7f68cc097e80 2024-04-26T07:29:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d3685700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc147500 con 0x7f68cc0a8380 2024-04-26T07:29:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d3685700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1477a0 con 0x7f68cc0a9980 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d1421700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d1421700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47094/0 (socket says 172.21.15.31:47094) 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d1421700 1 -- 172.21.15.31:0/2304219308 learned_addr learned my addr 172.21.15.31:0/2304219308 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d1c22700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc097e80 0x7f68cc130e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.695+0000 7f68d0c20700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f68cc0a9980 0x7f68cc130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d1421700 1 -- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f68cc0a9980 msgr2=0x7f68cc130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d1421700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f68cc0a9980 0x7f68cc130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d1421700 1 -- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc097e80 msgr2=0x7f68cc130e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d1421700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc097e80 0x7f68cc130e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d1421700 1 -- 172.21.15.31:0/2304219308 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc00b1e0 con 0x7f68cc0a8380 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d1c22700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc097e80 0x7f68cc130e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d1421700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc146bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f68bc00c000 tx=0x7f68bc006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68ba7fc700 1 -- 172.21.15.31:0/2304219308 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68bc012600 con 0x7f68cc0a8380 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68ba7fc700 1 -- 172.21.15.31:0/2304219308 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc012760 con 0x7f68cc0a8380 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c800b180 con 0x7f68cc0a8380 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68ba7fc700 1 -- 172.21.15.31:0/2304219308 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68bc012ac0 con 0x7f68cc0a8380 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.696+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc099160 con 0x7f68cc0a8380 2024-04-26T07:29:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.697+0000 7f68ba7fc700 1 -- 172.21.15.31:0/2304219308 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f68bc022070 con 0x7f68cc0a8380 2024-04-26T07:29:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.697+0000 7f68ba7fc700 1 -- 172.21.15.31:0/2304219308 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f68bc04ace0 con 0x7f68cc0a8380 2024-04-26T07:29:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.697+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc0a9e10 con 0x7f68cc0a8380 2024-04-26T07:29:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.700+0000 7f68ba7fc700 1 -- 172.21.15.31:0/2304219308 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f68bc033610 con 0x7f68cc0a8380 2024-04-26T07:29:56.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.817+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f68cc0a8eb0 con 0x7f68cc0a8380 2024-04-26T07:29:56.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.817+0000 7f68ba7fc700 1 -- 172.21.15.31:0/2304219308 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f68bc033200 con 0x7f68cc0a8380 2024-04-26T07:29:56.818 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-26T07:29:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 >> v1:172.21.15.31:6816/39613 conn(0x7f68ac038da0 legacy=0x7f68ac03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 msgr2=0x7f68cc146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc146bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f68bc00c000 tx=0x7f68bc006eb0).stop 2024-04-26T07:29:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 shutdown_connections 2024-04-26T07:29:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68cc097e80 0x7f68cc130e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f68cc0a8380 0x7f68cc146bd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 --2- 172.21.15.31:0/2304219308 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f68cc0a9980 0x7f68cc130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 >> 172.21.15.31:0/2304219308 conn(0x7f68cc061370 msgr2=0x7f68cc067790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 shutdown_connections 2024-04-26T07:29:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.819+0000 7f68d3685700 1 -- 172.21.15.31:0/2304219308 wait complete. 2024-04-26T07:29:56.829 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T07:29:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.940+0000 7face468c700 1 Processor -- start 2024-04-26T07:29:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.940+0000 7face468c700 1 -- start start 2024-04-26T07:29:56.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face468c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc067500 0x7facdc09a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face468c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7facdc09bc70 0x7facdc136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face468c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc09c070 0x7facdc136b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face468c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc1361b0 con 0x7facdc09bc70 2024-04-26T07:29:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face468c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc09b670 con 0x7facdc067500 2024-04-26T07:29:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face468c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facdc09b400 con 0x7facdc09c070 2024-04-26T07:29:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face2428700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc067500 0x7facdc09a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face2c29700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc09c070 0x7facdc136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face2428700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc067500 0x7facdc09a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47100/0 (socket says 172.21.15.31:47100) 2024-04-26T07:29:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face2c29700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc09c070 0x7facdc136b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:53040/0 (socket says 172.21.15.31:53040) 2024-04-26T07:29:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face2428700 1 -- 172.21.15.31:0/2626825353 learned_addr learned my addr 172.21.15.31:0/2626825353 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.941+0000 7face1c27700 1 --2- 172.21.15.31:0/2626825353 >> v2:172.21.15.31:3300/0 conn(0x7facdc09bc70 0x7facdc136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face2428700 1 -- 172.21.15.31:0/2626825353 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc09c070 msgr2=0x7facdc136b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face2428700 1 --2- 172.21.15.31:0/2626825353 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc09c070 0x7facdc136b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face2428700 1 -- 172.21.15.31:0/2626825353 >> v2:172.21.15.31:3300/0 conn(0x7facdc09bc70 msgr2=0x7facdc136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face2428700 1 --2- 172.21.15.31:0/2626825353 >> v2:172.21.15.31:3300/0 conn(0x7facdc09bc70 0x7facdc136660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face2428700 1 -- 172.21.15.31:0/2626825353 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc1363a0 con 0x7facdc067500 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face2c29700 1 --2- 172.21.15.31:0/2626825353 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc09c070 0x7facdc136b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face1c27700 1 --2- 172.21.15.31:0/2626825353 >> v2:172.21.15.31:3300/0 conn(0x7facdc09bc70 0x7facdc136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face2428700 1 --2- 172.21.15.31:0/2626825353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc067500 0x7facdc09a8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7faccc002f70 tx=0x7faccc006eb0).ready entity=mon.1 client_cookie=30d0adac65322ebc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:56.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face1426700 1 -- 172.21.15.31:0/2626825353 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc00d570 con 0x7facdc067500 2024-04-26T07:29:56.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face1426700 1 -- 172.21.15.31:0/2626825353 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc000e90 con 0x7facdc067500 2024-04-26T07:29:56.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face1426700 1 -- 172.21.15.31:0/2626825353 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc00d900 con 0x7facdc067500 2024-04-26T07:29:56.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 -- 172.21.15.31:0/2626825353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc067500 msgr2=0x7facdc09a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 --2- 172.21.15.31:0/2626825353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc067500 0x7facdc09a8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7faccc002f70 tx=0x7faccc006eb0).stop 2024-04-26T07:29:56.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 -- 172.21.15.31:0/2626825353 shutdown_connections 2024-04-26T07:29:56.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 --2- 172.21.15.31:0/2626825353 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc09c070 0x7facdc136b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 --2- 172.21.15.31:0/2626825353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc067500 0x7facdc09a8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 --2- 172.21.15.31:0/2626825353 >> v2:172.21.15.31:3300/0 conn(0x7facdc09bc70 0x7facdc136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 -- 172.21.15.31:0/2626825353 >> 172.21.15.31:0/2626825353 conn(0x7facdc05cfb0 msgr2=0x7facdc062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:56.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 -- 172.21.15.31:0/2626825353 shutdown_connections 2024-04-26T07:29:56.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.942+0000 7face468c700 1 -- 172.21.15.31:0/2626825353 wait complete. 2024-04-26T07:29:56.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.943+0000 7face468c700 1 Processor -- start 2024-04-26T07:29:56.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.943+0000 7face468c700 1 -- start start 2024-04-26T07:29:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face468c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc067500 0x7facdc149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face468c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7facdc09bc70 0x7facdc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face468c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc09c070 0x7facdc1323f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face468c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc1328e0 con 0x7facdc09bc70 2024-04-26T07:29:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face468c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc149c70 con 0x7facdc09c070 2024-04-26T07:29:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face468c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facdc1499d0 con 0x7facdc067500 2024-04-26T07:29:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc067500 0x7facdc149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face1c27700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7facdc09bc70 0x7facdc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2c29700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc09c070 0x7facdc1323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc067500 0x7facdc149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:53056/0 (socket says 172.21.15.31:53056) 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face1c27700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7facdc09bc70 0x7facdc131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58854/0 (socket says 172.21.15.31:58854) 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2c29700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc09c070 0x7facdc1323f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47104/0 (socket says 172.21.15.31:47104) 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 -- 172.21.15.31:0/1342547471 learned_addr learned my addr 172.21.15.31:0/1342547471 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 -- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc09c070 msgr2=0x7facdc1323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc09c070 0x7facdc1323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 -- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7facdc09bc70 msgr2=0x7facdc131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:56.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7facdc09bc70 0x7facdc131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 -- 172.21.15.31:0/1342547471 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd800b180 con 0x7facdc067500 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2c29700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc09c070 0x7facdc1323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face1c27700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7facdc09bc70 0x7facdc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.944+0000 7face2428700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc067500 0x7facdc149000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7facdc13ddf0 tx=0x7faccc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.945+0000 7faccb7fe700 1 -- 172.21.15.31:0/1342547471 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc011790 con 0x7facdc067500 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.945+0000 7faccb7fe700 1 -- 172.21.15.31:0/1342547471 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0118f0 con 0x7facdc067500 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.945+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd4009470 con 0x7facdc067500 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.945+0000 7faccb7fe700 1 -- 172.21.15.31:0/1342547471 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc011c50 con 0x7facdc067500 2024-04-26T07:29:56.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.945+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc00b1e0 con 0x7facdc067500 2024-04-26T07:29:56.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.945+0000 7faccb7fe700 1 -- 172.21.15.31:0/1342547471 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7faccc025030 con 0x7facdc067500 2024-04-26T07:29:56.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.946+0000 7faccb7fe700 1 -- 172.21.15.31:0/1342547471 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7faccc04bb20 con 0x7facdc067500 2024-04-26T07:29:56.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.946+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc137040 con 0x7facdc067500 2024-04-26T07:29:56.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:56.949+0000 7faccb7fe700 1 -- 172.21.15.31:0/1342547471 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7faccc023070 con 0x7facdc067500 2024-04-26T07:29:57.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.065+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7facdc06bbc0 con 0x7facdc067500 2024-04-26T07:29:57.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.065+0000 7faccb7fe700 1 -- 172.21.15.31:0/1342547471 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7faccc023030 con 0x7facdc067500 2024-04-26T07:29:57.065 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-26T07:29:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.066+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 >> v1:172.21.15.31:6816/39613 conn(0x7facbc038ec0 legacy=0x7facbc03b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.066+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc067500 msgr2=0x7facdc149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.066+0000 7face468c700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc067500 0x7facdc149000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7facdc13ddf0 tx=0x7faccc015000).stop 2024-04-26T07:29:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.066+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 shutdown_connections 2024-04-26T07:29:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.066+0000 7face468c700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7facdc067500 0x7facdc149000 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.066+0000 7face468c700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7facdc09c070 0x7facdc1323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.066+0000 7face468c700 1 --2- 172.21.15.31:0/1342547471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7facdc09bc70 0x7facdc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.067+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 >> 172.21.15.31:0/1342547471 conn(0x7facdc05cfb0 msgr2=0x7facdc132c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:57.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.067+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 shutdown_connections 2024-04-26T07:29:57.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.067+0000 7face468c700 1 -- 172.21.15.31:0/1342547471 wait complete. 2024-04-26T07:29:57.077 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T07:29:57.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.186+0000 7f5c45fab700 1 Processor -- start 2024-04-26T07:29:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.186+0000 7f5c45fab700 1 -- start start 2024-04-26T07:29:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.186+0000 7f5c45fab700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c4006c990 0x7f5c40136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.186+0000 7f5c45fab700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c40133340 0x7f5c401337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.186+0000 7f5c45fab700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4006cd70 con 0x7f5c400648b0 2024-04-26T07:29:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.186+0000 7f5c45fab700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c40137340 con 0x7f5c4006c990 2024-04-26T07:29:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.186+0000 7f5c45fab700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40132eb0 con 0x7f5c40133340 2024-04-26T07:29:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c4006c990 0x7f5c40136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c40133340 0x7f5c401337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5c400648b0 0x7f5c40136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57614/0 (socket says 172.21.15.31:57614) 2024-04-26T07:29:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3effd700 1 -- 172.21.15.31:0/1459793237 learned_addr learned my addr 172.21.15.31:0/1459793237 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3f7fe700 1 -- 172.21.15.31:0/1459793237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c40133340 msgr2=0x7f5c401337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3f7fe700 1 --2- 172.21.15.31:0/1459793237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c40133340 0x7f5c401337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3f7fe700 1 -- 172.21.15.31:0/1459793237 >> v1:172.21.15.31:6789/0 conn(0x7f5c400648b0 legacy=0x7f5c40136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3e7fc700 1 -- 172.21.15.31:0/1459793237 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439208131 0 0) 0x7f5c4006cd70 con 0x7f5c400648b0 2024-04-26T07:29:57.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3f7fe700 1 -- 172.21.15.31:0/1459793237 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40063c00 con 0x7f5c4006c990 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3ffff700 1 --2- 172.21.15.31:0/1459793237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c40133340 0x7f5c401337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3f7fe700 1 --2- 172.21.15.31:0/1459793237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4006c990 0x7f5c40136400 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5c34002f70 tx=0x7f5c34006df0).ready entity=mon.0 client_cookie=f4d0300accc7516f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3e7fc700 1 -- 172.21.15.31:0/1459793237 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c3400d570 con 0x7f5c4006c990 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3e7fc700 1 -- 172.21.15.31:0/1459793237 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34000e90 con 0x7f5c4006c990 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.187+0000 7f5c3e7fc700 1 -- 172.21.15.31:0/1459793237 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c3400d8c0 con 0x7f5c4006c990 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.188+0000 7f5c45fab700 1 -- 172.21.15.31:0/1459793237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4006c990 msgr2=0x7f5c40136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.188+0000 7f5c45fab700 1 --2- 172.21.15.31:0/1459793237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4006c990 0x7f5c40136400 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5c34002f70 tx=0x7f5c34006df0).stop 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.188+0000 7f5c45fab700 1 -- 172.21.15.31:0/1459793237 shutdown_connections 2024-04-26T07:29:57.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.188+0000 7f5c45fab700 1 --2- 172.21.15.31:0/1459793237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c40133340 0x7f5c401337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.188+0000 7f5c45fab700 1 --2- 172.21.15.31:0/1459793237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c4006c990 0x7f5c40136400 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.188+0000 7f5c45fab700 1 -- 172.21.15.31:0/1459793237 >> 172.21.15.31:0/1459793237 conn(0x7f5c40061370 msgr2=0x7f5c4006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.188+0000 7f5c45fab700 1 -- 172.21.15.31:0/1459793237 shutdown_connections 2024-04-26T07:29:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.188+0000 7f5c45fab700 1 -- 172.21.15.31:0/1459793237 wait complete. 2024-04-26T07:29:57.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.189+0000 7f5c45fab700 1 Processor -- start 2024-04-26T07:29:57.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.189+0000 7f5c45fab700 1 -- start start 2024-04-26T07:29:57.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c45fab700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c400648b0 0x7f5c40147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c45fab700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c4006c990 0x7f5c40137730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c45fab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c40133340 0x7f5c40137c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c45fab700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40139590 con 0x7f5c40133340 2024-04-26T07:29:57.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c45fab700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40147bd0 con 0x7f5c4006c990 2024-04-26T07:29:57.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c45fab700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400679d0 con 0x7f5c400648b0 2024-04-26T07:29:57.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c400648b0 0x7f5c40147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c4006c990 0x7f5c40137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c400648b0 0x7f5c40147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:53058/0 (socket says 172.21.15.31:53058) 2024-04-26T07:29:57.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3f7fe700 1 -- 172.21.15.31:0/914635156 learned_addr learned my addr 172.21.15.31:0/914635156 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:57.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3ffff700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c40133340 0x7f5c40137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3effd700 1 -- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c400648b0 msgr2=0x7f5c40147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3effd700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c400648b0 0x7f5c40147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3effd700 1 -- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c40133340 msgr2=0x7f5c40137c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3effd700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c40133340 0x7f5c40137c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3effd700 1 -- 172.21.15.31:0/914635156 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009470 con 0x7f5c4006c990 2024-04-26T07:29:57.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3f7fe700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c400648b0 0x7f5c40147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:57.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3effd700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c4006c990 0x7f5c40137730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f5c30000bc0 tx=0x7f5c30007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:57.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.190+0000 7f5c3cff9700 1 -- 172.21.15.31:0/914635156 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c30013070 con 0x7f5c4006c990 2024-04-26T07:29:57.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.191+0000 7f5c3cff9700 1 -- 172.21.15.31:0/914635156 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c300072c0 con 0x7f5c4006c990 2024-04-26T07:29:57.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.191+0000 7f5c3cff9700 1 -- 172.21.15.31:0/914635156 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c30005610 con 0x7f5c4006c990 2024-04-26T07:29:57.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.191+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3400b180 con 0x7f5c4006c990 2024-04-26T07:29:57.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.191+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4013b9e0 con 0x7f5c4006c990 2024-04-26T07:29:57.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.191+0000 7f5c3cff9700 1 -- 172.21.15.31:0/914635156 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5c30020070 con 0x7f5c4006c990 2024-04-26T07:29:57.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.191+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40133c90 con 0x7f5c4006c990 2024-04-26T07:29:57.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.192+0000 7f5c3cff9700 1 -- 172.21.15.31:0/914635156 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5c3004df70 con 0x7f5c4006c990 2024-04-26T07:29:57.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.195+0000 7f5c3cff9700 1 -- 172.21.15.31:0/914635156 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5c30032e70 con 0x7f5c4006c990 2024-04-26T07:29:57.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.311+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c40064dd0 con 0x7f5c4006c990 2024-04-26T07:29:57.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.312+0000 7f5c3cff9700 1 -- 172.21.15.31:0/914635156 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c30036490 con 0x7f5c4006c990 2024-04-26T07:29:57.312 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-26T07:29:57.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.313+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 >> v1:172.21.15.31:6816/39613 conn(0x7f5c20038f80 legacy=0x7f5c2003b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.313+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c4006c990 msgr2=0x7f5c40137730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.313+0000 7f5c45fab700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c4006c990 0x7f5c40137730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f5c30000bc0 tx=0x7f5c30007a70).stop 2024-04-26T07:29:57.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.313+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 shutdown_connections 2024-04-26T07:29:57.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.313+0000 7f5c45fab700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c400648b0 0x7f5c40147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.313+0000 7f5c45fab700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c40133340 0x7f5c40137c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.313+0000 7f5c45fab700 1 --2- 172.21.15.31:0/914635156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c4006c990 0x7f5c40137730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.313+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 >> 172.21.15.31:0/914635156 conn(0x7f5c40061370 msgr2=0x7f5c4009b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:57.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.314+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 shutdown_connections 2024-04-26T07:29:57.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.314+0000 7f5c45fab700 1 -- 172.21.15.31:0/914635156 wait complete. 2024-04-26T07:29:57.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T07:29:57.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.433+0000 7fbb0bf95700 1 Processor -- start 2024-04-26T07:29:57.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.433+0000 7fbb0bf95700 1 -- start start 2024-04-26T07:29:57.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb0bf95700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb0bf95700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb040648b0 0x7fbb04136c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb0bf95700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb04133340 0x7fbb041337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb0bf95700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb04132eb0 con 0x7fbb040648b0 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb0bf95700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0406cd70 con 0x7fbb0406c990 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb0bf95700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb04063c00 con 0x7fbb04133340 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb0a532700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb04133340 0x7fbb041337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09d31700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09530700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb040648b0 0x7fbb04136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09d31700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42340/0 (socket says 172.21.15.31:42340) 2024-04-26T07:29:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb0a532700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb04133340 0x7fbb041337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:58856/0 (socket says 172.21.15.31:58856) 2024-04-26T07:29:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09d31700 1 -- 172.21.15.31:0/2122663633 learned_addr learned my addr 172.21.15.31:0/2122663633 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09530700 1 -- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb04133340 msgr2=0x7fbb041337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09530700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb04133340 0x7fbb041337d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09530700 1 -- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 msgr2=0x7fbb04136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09530700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.434+0000 7fbb09530700 1 -- 172.21.15.31:0/2122663633 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb041330a0 con 0x7fbb040648b0 2024-04-26T07:29:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb09d31700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0a532700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb04133340 0x7fbb041337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb09530700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb040648b0 0x7fbb04136c30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fbb00002f70 tx=0x7fbb00006df0).ready entity=mon.0 client_cookie=48f1afc1c2ce23da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb08d2f700 1 -- 172.21.15.31:0/2122663633 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb0000d4a0 con 0x7fbb040648b0 2024-04-26T07:29:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb08d2f700 1 -- 172.21.15.31:0/2122663633 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb00000e90 con 0x7fbb040648b0 2024-04-26T07:29:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb08d2f700 1 -- 172.21.15.31:0/2122663633 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb0000d7f0 con 0x7fbb040648b0 2024-04-26T07:29:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 -- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb040648b0 msgr2=0x7fbb04136c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb040648b0 0x7fbb04136c30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fbb00002f70 tx=0x7fbb00006df0).stop 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 -- 172.21.15.31:0/2122663633 shutdown_connections 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb04133340 0x7fbb041337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 --2- 172.21.15.31:0/2122663633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb040648b0 0x7fbb04136c30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 -- 172.21.15.31:0/2122663633 >> 172.21.15.31:0/2122663633 conn(0x7fbb04061370 msgr2=0x7fbb0406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 -- 172.21.15.31:0/2122663633 shutdown_connections 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.435+0000 7fbb0bf95700 1 -- 172.21.15.31:0/2122663633 wait complete. 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.436+0000 7fbb0bf95700 1 Processor -- start 2024-04-26T07:29:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.436+0000 7fbb0bf95700 1 -- start start 2024-04-26T07:29:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb0bf95700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb040648b0 0x7fbb0413b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb0bf95700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb0bf95700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb04133340 0x7fbb04147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb0bf95700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0413a4e0 con 0x7fbb04133340 2024-04-26T07:29:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb0bf95700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb041395c0 con 0x7fbb0406c990 2024-04-26T07:29:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb0bf95700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb04139880 con 0x7fbb040648b0 2024-04-26T07:29:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb040648b0 0x7fbb0413b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb040648b0 0x7fbb0413b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:58868/0 (socket says 172.21.15.31:58868) 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 -- 172.21.15.31:0/1650537770 learned_addr learned my addr 172.21.15.31:0/1650537770 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09530700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb0a532700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb04133340 0x7fbb04147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 -- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 msgr2=0x7fbb04146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 -- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb04133340 msgr2=0x7fbb04147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb04133340 0x7fbb04147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 -- 172.21.15.31:0/1650537770 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf400b1e0 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.437+0000 7fbb09d31700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb040648b0 0x7fbb0413b4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbb0413b080 tx=0x7fbaf4006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.438+0000 7fbaf2ffd700 1 -- 172.21.15.31:0/1650537770 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaf400c610 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.438+0000 7fbaf2ffd700 1 -- 172.21.15.31:0/1650537770 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400c770 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.438+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbafc009470 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.438+0000 7fbaf2ffd700 1 -- 172.21.15.31:0/1650537770 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaf400cad0 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.438+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0000b180 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.439+0000 7fbaf2ffd700 1 -- 172.21.15.31:0/1650537770 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbaf4022070 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.439+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb04133d70 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.439+0000 7fbaf2ffd700 1 -- 172.21.15.31:0/1650537770 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbaf404ad40 con 0x7fbb040648b0 2024-04-26T07:29:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.442+0000 7fbaf2ffd700 1 -- 172.21.15.31:0/1650537770 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbaf4033670 con 0x7fbb040648b0 2024-04-26T07:29:57.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.559+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb0406bbc0 con 0x7fbb040648b0 2024-04-26T07:29:57.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.559+0000 7fbaf2ffd700 1 -- 172.21.15.31:0/1650537770 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbaf4033260 con 0x7fbb040648b0 2024-04-26T07:29:57.560 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-26T07:29:57.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 >> v1:172.21.15.31:6816/39613 conn(0x7fbae4038ef0 legacy=0x7fbae403b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb040648b0 msgr2=0x7fbb0413b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb040648b0 0x7fbb0413b4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbb0413b080 tx=0x7fbaf4006eb0).stop 2024-04-26T07:29:57.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 shutdown_connections 2024-04-26T07:29:57.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb040648b0 0x7fbb0413b4e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb04133340 0x7fbb04147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 --2- 172.21.15.31:0/1650537770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb0406c990 0x7fbb04146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 >> 172.21.15.31:0/1650537770 conn(0x7fbb04061370 msgr2=0x7fbb04062f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:57.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 shutdown_connections 2024-04-26T07:29:57.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.560+0000 7fbb0bf95700 1 -- 172.21.15.31:0/1650537770 wait complete. 2024-04-26T07:29:57.571 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T07:29:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.678+0000 7f4ee0edf700 1 Processor -- start 2024-04-26T07:29:57.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.678+0000 7f4ee0edf700 1 -- start start 2024-04-26T07:29:57.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ee0edf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc06c7d0 0x7f4edc1360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ee0edf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4edc096320 0x7f4edc05b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ee0edf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc05be60 0x7f4edc05c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ee0edf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc133c10 con 0x7f4edc096320 2024-04-26T07:29:57.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ee0edf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc05c800 con 0x7f4edc06c7d0 2024-04-26T07:29:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ee0edf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0970a0 con 0x7f4edc05be60 2024-04-26T07:29:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4edad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc05be60 0x7f4edc05c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4eda59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc06c7d0 0x7f4edc1360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed9d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4edc096320 0x7f4edc05b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4edad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc05be60 0x7f4edc05c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:58878/0 (socket says 172.21.15.31:58878) 2024-04-26T07:29:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4eda59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc06c7d0 0x7f4edc1360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42358/0 (socket says 172.21.15.31:42358) 2024-04-26T07:29:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4edad9d700 1 -- 172.21.15.31:0/2648029397 learned_addr learned my addr 172.21.15.31:0/2648029397 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:57.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed9d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4edc096320 0x7f4edc05b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38180/0 (socket says 172.21.15.31:38180) 2024-04-26T07:29:57.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed9d9b700 1 -- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc05be60 msgr2=0x7f4edc05c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:57.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed9d9b700 1 --2- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc05be60 0x7f4edc05c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed9d9b700 1 -- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc06c7d0 msgr2=0x7f4edc1360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:57.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed9d9b700 1 --2- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc06c7d0 0x7f4edc1360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed9d9b700 1 -- 172.21.15.31:0/2648029397 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc136780 con 0x7f4edc096320 2024-04-26T07:29:57.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4eda59c700 1 --2- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc06c7d0 0x7f4edc1360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:57.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed9d9b700 1 --2- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 0x7f4edc05b970 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f4ed0002f70 tx=0x7f4ed0006df0).ready entity=mon.0 client_cookie=b3c00f02bd35a570 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:57.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed959a700 1 -- 172.21.15.31:0/2648029397 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed000d4a0 con 0x7f4edc096320 2024-04-26T07:29:57.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed959a700 1 -- 172.21.15.31:0/2648029397 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0000e90 con 0x7f4edc096320 2024-04-26T07:29:57.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.679+0000 7f4ed959a700 1 -- 172.21.15.31:0/2648029397 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed000d7f0 con 0x7f4edc096320 2024-04-26T07:29:57.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 -- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 msgr2=0x7f4edc05b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 --2- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 0x7f4edc05b970 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f4ed0002f70 tx=0x7f4ed0006df0).stop 2024-04-26T07:29:57.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 -- 172.21.15.31:0/2648029397 shutdown_connections 2024-04-26T07:29:57.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 --2- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc05be60 0x7f4edc05c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 --2- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc06c7d0 0x7f4edc1360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 --2- 172.21.15.31:0/2648029397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 0x7f4edc05b970 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 -- 172.21.15.31:0/2648029397 >> 172.21.15.31:0/2648029397 conn(0x7f4edc061370 msgr2=0x7f4edc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:57.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 -- 172.21.15.31:0/2648029397 shutdown_connections 2024-04-26T07:29:57.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.680+0000 7f4ee0edf700 1 -- 172.21.15.31:0/2648029397 wait complete. 2024-04-26T07:29:57.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.681+0000 7f4ee0edf700 1 Processor -- start 2024-04-26T07:29:57.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.681+0000 7f4ee0edf700 1 -- start start 2024-04-26T07:29:57.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.681+0000 7f4ee0edf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc05be60 0x7f4edc1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.681+0000 7f4ee0edf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc06c7d0 0x7f4edc1494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.681+0000 7f4ee0edf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 0x7f4edc1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.681+0000 7f4ee0edf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc145ef0 con 0x7f4edc096320 2024-04-26T07:29:57.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.681+0000 7f4ee0edf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc146d80 con 0x7f4edc05be60 2024-04-26T07:29:57.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.681+0000 7f4ee0edf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0620a0 con 0x7f4edc06c7d0 2024-04-26T07:29:57.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc05be60 0x7f4edc1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc05be60 0x7f4edc1463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42374/0 (socket says 172.21.15.31:42374) 2024-04-26T07:29:57.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 -- 172.21.15.31:0/3034109424 learned_addr learned my addr 172.21.15.31:0/3034109424 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:57.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4edad9d700 1 --2- 172.21.15.31:0/3034109424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 0x7f4edc1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4ed9d9b700 1 --2- 172.21.15.31:0/3034109424 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc06c7d0 0x7f4edc1494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 -- 172.21.15.31:0/3034109424 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc06c7d0 msgr2=0x7f4edc1494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 --2- 172.21.15.31:0/3034109424 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4edc06c7d0 0x7f4edc1494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 -- 172.21.15.31:0/3034109424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 msgr2=0x7f4edc1499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 --2- 172.21.15.31:0/3034109424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 0x7f4edc1499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 -- 172.21.15.31:0/3034109424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc00b180 con 0x7f4edc05be60 2024-04-26T07:29:57.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4edad9d700 1 --2- 172.21.15.31:0/3034109424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc096320 0x7f4edc1499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:57.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4eda59c700 1 --2- 172.21.15.31:0/3034109424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4edc05be60 0x7f4edc1463b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f4ecc00c000 tx=0x7f4ecc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:57.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4ecb7fe700 1 -- 172.21.15.31:0/3034109424 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ecc00c7e0 con 0x7f4edc05be60 2024-04-26T07:29:57.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4ecb7fe700 1 -- 172.21.15.31:0/3034109424 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc00c940 con 0x7f4edc05be60 2024-04-26T07:29:57.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4ee0edf700 1 -- 172.21.15.31:0/3034109424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed000b180 con 0x7f4edc05be60 2024-04-26T07:29:57.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4ecb7fe700 1 -- 172.21.15.31:0/3034109424 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ecc00cca0 con 0x7f4edc05be60 2024-04-26T07:29:57.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.682+0000 7f4ee0edf700 1 -- 172.21.15.31:0/3034109424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc13a100 con 0x7f4edc05be60 2024-04-26T07:29:57.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.683+0000 7f4ecb7fe700 1 -- 172.21.15.31:0/3034109424 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4ecc01c460 con 0x7f4edc05be60 2024-04-26T07:29:57.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.683+0000 7f4ecb7fe700 1 -- 172.21.15.31:0/3034109424 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4ecc04ae30 con 0x7f4edc05be60 2024-04-26T07:29:57.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.683+0000 7f4ee0edf700 1 -- 172.21.15.31:0/3034109424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc136a40 con 0x7f4edc05be60 2024-04-26T07:29:57.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.686+0000 7f4ecb7fe700 1 -- 172.21.15.31:0/3034109424 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4ecc030150 con 0x7f4edc05be60 2024-04-26T07:29:57.844 INFO:teuthology.orchestra.run.smithi031.stderr:no valid command found; 10 closest matches: 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd perf 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd df [plain|tree] [class|name] [] 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd blocked-by 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool stats [] 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool scrub ... 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool deep-scrub ... 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool repair ... 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool force-recovery ... 2024-04-26T07:29:57.845 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool force-backfill ... 2024-04-26T07:29:57.846 INFO:teuthology.orchestra.run.smithi031.stderr:osd pool cancel-force-recovery ... 2024-04-26T07:29:57.846 INFO:teuthology.orchestra.run.smithi031.stderr:Error EINVAL: invalid command 2024-04-26T07:29:57.847 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T07:29:57.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-04-26T07:29:57.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.955+0000 7fe603784700 1 Processor -- start 2024-04-26T07:29:57.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.955+0000 7fe603784700 1 -- start start 2024-04-26T07:29:57.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe603784700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5fc09a8f0 0x7fe5fc136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe603784700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc136b50 0x7fe5fc140a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe603784700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc09b670 con 0x7fe5fc067500 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe603784700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc09c380 con 0x7fe5fc09a8f0 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe603784700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc1361b0 con 0x7fe5fc136b50 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe601d21700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc136b50 0x7fe5fc140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe600d1f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5fc09a8f0 0x7fe5fc136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe601520700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe5fc067500 0x7fe5fc09bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60124/0 (socket says 172.21.15.31:60124) 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe601520700 1 -- 172.21.15.31:0/472268938 learned_addr learned my addr 172.21.15.31:0/472268938 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe600d1f700 1 -- 172.21.15.31:0/472268938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc136b50 msgr2=0x7fe5fc140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:29:57.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe600d1f700 1 --2- 172.21.15.31:0/472268938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc136b50 0x7fe5fc140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe600d1f700 1 -- 172.21.15.31:0/472268938 >> v1:172.21.15.31:6789/0 conn(0x7fe5fc067500 legacy=0x7fe5fc09bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.956+0000 7fe5ebfff700 1 -- 172.21.15.31:0/472268938 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416719726 0 0) 0x7fe5fc09b670 con 0x7fe5fc067500 2024-04-26T07:29:57.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe600d1f700 1 -- 172.21.15.31:0/472268938 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc09b400 con 0x7fe5fc09a8f0 2024-04-26T07:29:57.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe601d21700 1 --2- 172.21.15.31:0/472268938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc136b50 0x7fe5fc140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:29:57.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe600d1f700 1 --2- 172.21.15.31:0/472268938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc09a8f0 0x7fe5fc136660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fe5fc09bac0 tx=0x7fe5f8006df0).ready entity=mon.0 client_cookie=2ff4f108b425ba72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:57.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe5ebfff700 1 -- 172.21.15.31:0/472268938 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f800d570 con 0x7fe5fc09a8f0 2024-04-26T07:29:57.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe5ebfff700 1 -- 172.21.15.31:0/472268938 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8000e90 con 0x7fe5fc09a8f0 2024-04-26T07:29:57.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe5ebfff700 1 -- 172.21.15.31:0/472268938 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f800d8c0 con 0x7fe5fc09a8f0 2024-04-26T07:29:57.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe603784700 1 -- 172.21.15.31:0/472268938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc09a8f0 msgr2=0x7fe5fc136660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe603784700 1 --2- 172.21.15.31:0/472268938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc09a8f0 0x7fe5fc136660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fe5fc09bac0 tx=0x7fe5f8006df0).stop 2024-04-26T07:29:57.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe603784700 1 -- 172.21.15.31:0/472268938 shutdown_connections 2024-04-26T07:29:57.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe603784700 1 --2- 172.21.15.31:0/472268938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc136b50 0x7fe5fc140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe603784700 1 --2- 172.21.15.31:0/472268938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc09a8f0 0x7fe5fc136660 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe603784700 1 -- 172.21.15.31:0/472268938 >> 172.21.15.31:0/472268938 conn(0x7fe5fc05cfb0 msgr2=0x7fe5fc062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:57.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe603784700 1 -- 172.21.15.31:0/472268938 shutdown_connections 2024-04-26T07:29:57.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.957+0000 7fe603784700 1 -- 172.21.15.31:0/472268938 wait complete. 2024-04-26T07:29:57.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.958+0000 7fe603784700 1 Processor -- start 2024-04-26T07:29:57.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.958+0000 7fe603784700 1 -- start start 2024-04-26T07:29:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe603784700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc067500 0x7fe5fc092540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe603784700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc09a8f0 0x7fe5fc148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe603784700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5fc136b50 0x7fe5fc145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:29:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe603784700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc1454b0 con 0x7fe5fc067500 2024-04-26T07:29:57.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe603784700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc149780 con 0x7fe5fc136b50 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe603784700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0a9a80 con 0x7fe5fc09a8f0 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc067500 0x7fe5fc092540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc067500 0x7fe5fc092540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38208/0 (socket says 172.21.15.31:38208) 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 -- 172.21.15.31:0/605954522 learned_addr learned my addr 172.21.15.31:0/605954522 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe600d1f700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc09a8f0 0x7fe5fc148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601d21700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5fc136b50 0x7fe5fc145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 -- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc09a8f0 msgr2=0x7fe5fc148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc09a8f0 0x7fe5fc148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 -- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5fc136b50 msgr2=0x7fe5fc145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5fc136b50 0x7fe5fc145830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 -- 172.21.15.31:0/605954522 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f4009470 con 0x7fe5fc067500 2024-04-26T07:29:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe601520700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc067500 0x7fe5fc092540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fe5ec000bc0 tx=0x7fe5ec007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:29:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.959+0000 7fe5ea7fc700 1 -- 172.21.15.31:0/605954522 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5ec0070d0 con 0x7fe5fc067500 2024-04-26T07:29:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.960+0000 7fe5ea7fc700 1 -- 172.21.15.31:0/605954522 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec007230 con 0x7fe5fc067500 2024-04-26T07:29:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.960+0000 7fe5ea7fc700 1 -- 172.21.15.31:0/605954522 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5ec005610 con 0x7fe5fc067500 2024-04-26T07:29:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.960+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f800b180 con 0x7fe5fc067500 2024-04-26T07:29:57.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.960+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc139f90 con 0x7fe5fc067500 2024-04-26T07:29:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.960+0000 7fe5ea7fc700 1 -- 172.21.15.31:0/605954522 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe5ec010070 con 0x7fe5fc067500 2024-04-26T07:29:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.961+0000 7fe5ea7fc700 1 -- 172.21.15.31:0/605954522 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe5ec049fe0 con 0x7fe5fc067500 2024-04-26T07:29:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.961+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc1363a0 con 0x7fe5fc067500 2024-04-26T07:29:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:57.964+0000 7fe5ea7fc700 1 -- 172.21.15.31:0/605954522 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe5ec02eee0 con 0x7fe5fc067500 2024-04-26T07:29:58.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.098+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) v1 -- 0x7fe5fc062b20 con 0x7fe5fc067500 2024-04-26T07:29:58.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.098+0000 7fe5ea7fc700 1 -- 172.21.15.31:0/605954522 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v19) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe5ec032500 con 0x7fe5fc067500 2024-04-26T07:29:58.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 >> v1:172.21.15.31:6816/39613 conn(0x7fe5dc038da0 legacy=0x7fe5dc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:58.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc067500 msgr2=0x7fe5fc092540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:29:58.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc067500 0x7fe5fc092540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fe5ec000bc0 tx=0x7fe5ec007a60).stop 2024-04-26T07:29:58.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 shutdown_connections 2024-04-26T07:29:58.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5fc136b50 0x7fe5fc145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:58.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5fc067500 0x7fe5fc092540 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:58.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 --2- 172.21.15.31:0/605954522 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe5fc09a8f0 0x7fe5fc148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:29:58.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 >> 172.21.15.31:0/605954522 conn(0x7fe5fc05cfb0 msgr2=0x7fe5fc09c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:29:58.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 shutdown_connections 2024-04-26T07:29:58.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:29:58.099+0000 7fe603784700 1 -- 172.21.15.31:0/605954522 wait complete. 2024-04-26T07:29:58.101 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-04-26T07:29:58.110 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi172.front.sepia.ceph.com... 2024-04-26T07:29:58.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:29:58.110 DEBUG:teuthology.orchestra.run.smithi172:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T07:29:58.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[37422]: fuse finished with error 0 and tester_r 0 2024-04-26T07:29:58.150 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:30:04.252 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T07:30:04.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:30:04.252 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T07:30:04.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:30:04.289 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-04-26T07:30:04.312 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T07:30:04.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:30:04.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T07:30:04.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:30:04.399 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2024-04-26T07:30:04.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:30:04.469 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-26T07:30:04.491 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T07:30:04.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:30:04.491 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T07:30:04.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T07:30:04.573 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-26T07:30:04.670 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T07:30:04.681 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T07:30:04.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:30:04.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.803+0000 7fa8f4693700 1 Processor -- start 2024-04-26T07:30:04.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.803+0000 7fa8f4693700 1 -- start start 2024-04-26T07:30:04.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.803+0000 7fa8f4693700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec099bd0 0x7fa8ec098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.803+0000 7fa8f4693700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec095040 0x7fa8ec099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.803+0000 7fa8f4693700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec094330 con 0x7fa8ec1359b0 2024-04-26T07:30:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.803+0000 7fa8f4693700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec099500 con 0x7fa8ec099bd0 2024-04-26T07:30:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.803+0000 7fa8f4693700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0997a0 con 0x7fa8ec095040 2024-04-26T07:30:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f1c2e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec095040 0x7fa8ec099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f242f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec099bd0 0x7fa8ec098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f2c30700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa8ec1359b0 0x7fa8ec135e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60140/0 (socket says 172.21.15.31:60140) 2024-04-26T07:30:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f2c30700 1 -- 172.21.15.31:0/4235698284 learned_addr learned my addr 172.21.15.31:0/4235698284 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:04.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f142d700 1 -- 172.21.15.31:0/4235698284 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261801294 0 0) 0x7fa8ec094330 con 0x7fa8ec1359b0 2024-04-26T07:30:04.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f242f700 1 -- 172.21.15.31:0/4235698284 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec095040 msgr2=0x7fa8ec099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:04.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f242f700 1 --2- 172.21.15.31:0/4235698284 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec095040 0x7fa8ec099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:04.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f242f700 1 -- 172.21.15.31:0/4235698284 >> v1:172.21.15.31:6789/0 conn(0x7fa8ec1359b0 legacy=0x7fa8ec135e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:04.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f242f700 1 -- 172.21.15.31:0/4235698284 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec09a4a0 con 0x7fa8ec099bd0 2024-04-26T07:30:04.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f1c2e700 1 --2- 172.21.15.31:0/4235698284 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec095040 0x7fa8ec099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:04.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f242f700 1 --2- 172.21.15.31:0/4235698284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec099bd0 0x7fa8ec098f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa8e8002f70 tx=0x7fa8e8006df0).ready entity=mon.1 client_cookie=5f129f3782dcd4a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:04.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f142d700 1 -- 172.21.15.31:0/4235698284 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e8014070 con 0x7fa8ec099bd0 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f142d700 1 -- 172.21.15.31:0/4235698284 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e8000e90 con 0x7fa8ec099bd0 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.804+0000 7fa8f142d700 1 -- 172.21.15.31:0/4235698284 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e800fb60 con 0x7fa8ec099bd0 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.805+0000 7fa8f4693700 1 -- 172.21.15.31:0/4235698284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec099bd0 msgr2=0x7fa8ec098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.805+0000 7fa8f4693700 1 --2- 172.21.15.31:0/4235698284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec099bd0 0x7fa8ec098f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa8e8002f70 tx=0x7fa8e8006df0).stop 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.805+0000 7fa8f4693700 1 -- 172.21.15.31:0/4235698284 shutdown_connections 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.805+0000 7fa8f4693700 1 --2- 172.21.15.31:0/4235698284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec099bd0 0x7fa8ec098f50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.805+0000 7fa8f4693700 1 --2- 172.21.15.31:0/4235698284 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec095040 0x7fa8ec099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.805+0000 7fa8f4693700 1 -- 172.21.15.31:0/4235698284 >> 172.21.15.31:0/4235698284 conn(0x7fa8ec06c0c0 msgr2=0x7fa8ec06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:04.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.805+0000 7fa8f4693700 1 -- 172.21.15.31:0/4235698284 shutdown_connections 2024-04-26T07:30:04.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.805+0000 7fa8f4693700 1 -- 172.21.15.31:0/4235698284 wait complete. 2024-04-26T07:30:04.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.806+0000 7fa8f4693700 1 Processor -- start 2024-04-26T07:30:04.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.806+0000 7fa8f4693700 1 -- start start 2024-04-26T07:30:04.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f4693700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec095040 0x7fa8ec09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:04.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f4693700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8ec099bd0 0x7fa8ec09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:04.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f4693700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec1359b0 0x7fa8ec145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f4693700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec09c060 con 0x7fa8ec099bd0 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f4693700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec09e820 con 0x7fa8ec095040 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f4693700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec09df90 con 0x7fa8ec1359b0 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f242f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec095040 0x7fa8ec09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f2c30700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec1359b0 0x7fa8ec145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f1c2e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8ec099bd0 0x7fa8ec09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f1c2e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8ec099bd0 0x7fa8ec09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38220/0 (socket says 172.21.15.31:38220) 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f242f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec095040 0x7fa8ec09daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42410/0 (socket says 172.21.15.31:42410) 2024-04-26T07:30:04.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f1c2e700 1 -- 172.21.15.31:0/1198138643 learned_addr learned my addr 172.21.15.31:0/1198138643 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f2c30700 1 -- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec095040 msgr2=0x7fa8ec09daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f2c30700 1 --2- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec095040 0x7fa8ec09daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f2c30700 1 -- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8ec099bd0 msgr2=0x7fa8ec09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f2c30700 1 --2- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8ec099bd0 0x7fa8ec09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f2c30700 1 -- 172.21.15.31:0/1198138643 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc00c310 con 0x7fa8ec1359b0 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f2c30700 1 --2- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec1359b0 0x7fa8ec145ff0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa8e4001250 tx=0x7fa8e4007f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8db7fe700 1 -- 172.21.15.31:0/1198138643 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e400ce80 con 0x7fa8ec1359b0 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8db7fe700 1 -- 172.21.15.31:0/1198138643 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4005ba0 con 0x7fa8ec1359b0 2024-04-26T07:30:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e800b180 con 0x7fa8ec1359b0 2024-04-26T07:30:04.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8db7fe700 1 -- 172.21.15.31:0/1198138643 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8e40048a0 con 0x7fa8ec1359b0 2024-04-26T07:30:04.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.807+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec145a40 con 0x7fa8ec1359b0 2024-04-26T07:30:04.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.808+0000 7fa8db7fe700 1 -- 172.21.15.31:0/1198138643 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa8e4004a00 con 0x7fa8ec1359b0 2024-04-26T07:30:04.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.809+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec094ae0 con 0x7fa8ec1359b0 2024-04-26T07:30:04.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.809+0000 7fa8db7fe700 1 -- 172.21.15.31:0/1198138643 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa8e404a2d0 con 0x7fa8ec1359b0 2024-04-26T07:30:04.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.812+0000 7fa8db7fe700 1 -- 172.21.15.31:0/1198138643 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa8e402f1d0 con 0x7fa8ec1359b0 2024-04-26T07:30:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.925+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8ec06bbc0 con 0x7fa8cc038e30 2024-04-26T07:30:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.932+0000 7fa8db7fe700 1 -- 172.21.15.31:0/1198138643 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252030 (unknown 2965378022 0 2259004093) 0x7fa8ec06bbc0 con 0x7fa8cc038e30 2024-04-26T07:30:04.936 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:30:04.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 >> v1:172.21.15.31:6816/39613 conn(0x7fa8cc038e30 legacy=0x7fa8cc03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:04.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec1359b0 msgr2=0x7fa8ec145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:04.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 --2- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec1359b0 0x7fa8ec145ff0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa8e4001250 tx=0x7fa8e4007f20).stop 2024-04-26T07:30:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 shutdown_connections 2024-04-26T07:30:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 --2- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa8ec1359b0 0x7fa8ec145ff0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 --2- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8ec095040 0x7fa8ec09daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 --2- 172.21.15.31:0/1198138643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8ec099bd0 0x7fa8ec09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 >> 172.21.15.31:0/1198138643 conn(0x7fa8ec06c0c0 msgr2=0x7fa8ec136210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 shutdown_connections 2024-04-26T07:30:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:04.935+0000 7fa8f4693700 1 -- 172.21.15.31:0/1198138643 wait complete. 2024-04-26T07:30:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:30:04.945 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-26T07:30:03.995195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002696"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140126+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:32.140126+0000","last_peered":"2024-04-26T07:28:32.140126+0000","last_clean":"2024-04-26T07:28:32.140126+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:32.140126+0000","last_undegraded":"2024-04-26T07:28:32.140126+0000","last_fullsized":"2024-04-26T07:28:32.140126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140737+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:32.140737+0000","last_peered":"2024-04-26T07:28:32.140737+0000","last_clean":"2024-04-26T07:28:32.140737+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:32.140737+0000","last_undegraded":"2024-04-26T07:28:32.140737+0000","last_fullsized":"2024-04-26T07:28:32.140737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143288+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:32.143288+0000","last_peered":"2024-04-26T07:28:32.143288+0000","last_clean":"2024-04-26T07:28:32.143288+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:32.143288+0000","last_undegraded":"2024-04-26T07:28:32.143288+0000","last_fullsized":"2024-04-26T07:28:32.143288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143164+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:32.143164+0000","last_peered":"2024-04-26T07:28:32.143164+0000","last_clean":"2024-04-26T07:28:32.143164+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:32.143164+0000","last_undegraded":"2024-04-26T07:28:32.143164+0000","last_fullsized":"2024-04-26T07:28:32.143164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142620+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:32.142620+0000","last_peered":"2024-04-26T07:28:32.142620+0000","last_clean":"2024-04-26T07:28:32.142620+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:32.142620+0000","last_undegraded":"2024-04-26T07:28:32.142620+0000","last_fullsized":"2024-04-26T07:28:32.142620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137729+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:32.137729+0000","last_peered":"2024-04-26T07:28:32.137729+0000","last_clean":"2024-04-26T07:28:32.137729+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:32.137729+0000","last_undegraded":"2024-04-26T07:28:32.137729+0000","last_fullsized":"2024-04-26T07:28:32.137729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143368+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:32.143368+0000","last_peered":"2024-04-26T07:28:32.143368+0000","last_clean":"2024-04-26T07:28:32.143368+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:32.143368+0000","last_undegraded":"2024-04-26T07:28:32.143368+0000","last_fullsized":"2024-04-26T07:28:32.143368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138820+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:32.138820+0000","last_peered":"2024-04-26T07:28:32.138820+0000","last_clean":"2024-04-26T07:28:32.138820+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:32.138820+0000","last_undegraded":"2024-04-26T07:28:32.138820+0000","last_fullsized":"2024-04-26T07:28:32.138820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138789+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:32.138789+0000","last_peered":"2024-04-26T07:28:32.138789+0000","last_clean":"2024-04-26T07:28:32.138789+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:32.138789+0000","last_undegraded":"2024-04-26T07:28:32.138789+0000","last_fullsized":"2024-04-26T07:28:32.138789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140217+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:32.140217+0000","last_peered":"2024-04-26T07:28:32.140217+0000","last_clean":"2024-04-26T07:28:32.140217+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:32.140217+0000","last_undegraded":"2024-04-26T07:28:32.140217+0000","last_fullsized":"2024-04-26T07:28:32.140217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140887+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:32.140887+0000","last_peered":"2024-04-26T07:28:32.140887+0000","last_clean":"2024-04-26T07:28:32.140887+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:32.140887+0000","last_undegraded":"2024-04-26T07:28:32.140887+0000","last_fullsized":"2024-04-26T07:28:32.140887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138879+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:32.138879+0000","last_peered":"2024-04-26T07:28:32.138879+0000","last_clean":"2024-04-26T07:28:32.138879+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:32.138879+0000","last_undegraded":"2024-04-26T07:28:32.138879+0000","last_fullsized":"2024-04-26T07:28:32.138879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142710+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:32.142710+0000","last_peered":"2024-04-26T07:28:32.142710+0000","last_clean":"2024-04-26T07:28:32.142710+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:32.142710+0000","last_undegraded":"2024-04-26T07:28:32.142710+0000","last_fullsized":"2024-04-26T07:28:32.142710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143257+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:32.143257+0000","last_peered":"2024-04-26T07:28:32.143257+0000","last_clean":"2024-04-26T07:28:32.143257+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:32.143257+0000","last_undegraded":"2024-04-26T07:28:32.143257+0000","last_fullsized":"2024-04-26T07:28:32.143257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142802+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:32.142802+0000","last_peered":"2024-04-26T07:28:32.142802+0000","last_clean":"2024-04-26T07:28:32.142802+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:32.142802+0000","last_undegraded":"2024-04-26T07:28:32.142802+0000","last_fullsized":"2024-04-26T07:28:32.142802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139998+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:32.139998+0000","last_peered":"2024-04-26T07:28:32.139998+0000","last_clean":"2024-04-26T07:28:32.139998+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:32.139998+0000","last_undegraded":"2024-04-26T07:28:32.139998+0000","last_fullsized":"2024-04-26T07:28:32.139998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139079+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:32.139079+0000","last_peered":"2024-04-26T07:28:32.139079+0000","last_clean":"2024-04-26T07:28:32.139079+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:32.139079+0000","last_undegraded":"2024-04-26T07:28:32.139079+0000","last_fullsized":"2024-04-26T07:28:32.139079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138354+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.138354+0000","last_peered":"2024-04-26T07:28:32.138354+0000","last_clean":"2024-04-26T07:28:32.138354+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:32.138354+0000","last_undegraded":"2024-04-26T07:28:32.138354+0000","last_fullsized":"2024-04-26T07:28:32.138354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142486+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:32.142486+0000","last_peered":"2024-04-26T07:28:32.142486+0000","last_clean":"2024-04-26T07:28:32.142486+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:32.142486+0000","last_undegraded":"2024-04-26T07:28:32.142486+0000","last_fullsized":"2024-04-26T07:28:32.142486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137844+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:32.137844+0000","last_peered":"2024-04-26T07:28:32.137844+0000","last_clean":"2024-04-26T07:28:32.137844+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:32.137844+0000","last_undegraded":"2024-04-26T07:28:32.137844+0000","last_fullsized":"2024-04-26T07:28:32.137844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140794+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.140794+0000","last_peered":"2024-04-26T07:28:32.140794+0000","last_clean":"2024-04-26T07:28:32.140794+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:32.140794+0000","last_undegraded":"2024-04-26T07:28:32.140794+0000","last_fullsized":"2024-04-26T07:28:32.140794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138683+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:32.138683+0000","last_peered":"2024-04-26T07:28:32.138683+0000","last_clean":"2024-04-26T07:28:32.138683+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:32.138683+0000","last_undegraded":"2024-04-26T07:28:32.138683+0000","last_fullsized":"2024-04-26T07:28:32.138683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137704+0000","last_change":"2024-04-26T07:28:30.838970+0000","last_active":"2024-04-26T07:28:32.137704+0000","last_peered":"2024-04-26T07:28:32.137704+0000","last_clean":"2024-04-26T07:28:32.137704+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:28:32.137704+0000","last_undegraded":"2024-04-26T07:28:32.137704+0000","last_fullsized":"2024-04-26T07:28:32.137704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138132+0000","last_change":"2024-04-26T07:28:30.845233+0000","last_active":"2024-04-26T07:28:32.138132+0000","last_peered":"2024-04-26T07:28:32.138132+0000","last_clean":"2024-04-26T07:28:32.138132+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:28:32.138132+0000","last_undegraded":"2024-04-26T07:28:32.138132+0000","last_fullsized":"2024-04-26T07:28:32.138132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142948+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:32.142948+0000","last_peered":"2024-04-26T07:28:32.142948+0000","last_clean":"2024-04-26T07:28:32.142948+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:32.142948+0000","last_undegraded":"2024-04-26T07:28:32.142948+0000","last_fullsized":"2024-04-26T07:28:32.142948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847320+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:33.847320+0000","last_peered":"2024-04-26T07:28:33.847320+0000","last_clean":"2024-04-26T07:28:33.847320+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:33.847320+0000","last_undegraded":"2024-04-26T07:28:33.847320+0000","last_fullsized":"2024-04-26T07:28:33.847320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'7","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:12.136901+0000","last_change":"2024-04-26T07:28:30.850023+0000","last_active":"2024-04-26T07:29:12.136901+0000","last_peered":"2024-04-26T07:29:12.136901+0000","last_clean":"2024-04-26T07:29:12.136901+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:29:12.136901+0000","last_undegraded":"2024-04-26T07:29:12.136901+0000","last_fullsized":"2024-04-26T07:29:12.136901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137664+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:32.137664+0000","last_peered":"2024-04-26T07:28:32.137664+0000","last_clean":"2024-04-26T07:28:32.137664+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:32.137664+0000","last_undegraded":"2024-04-26T07:28:32.137664+0000","last_fullsized":"2024-04-26T07:28:32.137664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848610+0000","last_change":"2024-04-26T07:28:30.853633+0000","last_active":"2024-04-26T07:28:33.848610+0000","last_peered":"2024-04-26T07:28:33.848610+0000","last_clean":"2024-04-26T07:28:33.848610+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:28:33.848610+0000","last_undegraded":"2024-04-26T07:28:33.848610+0000","last_fullsized":"2024-04-26T07:28:33.848610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138363+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:32.138363+0000","last_peered":"2024-04-26T07:28:32.138363+0000","last_clean":"2024-04-26T07:28:32.138363+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:32.138363+0000","last_undegraded":"2024-04-26T07:28:32.138363+0000","last_fullsized":"2024-04-26T07:28:32.138363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848435+0000","last_change":"2024-04-26T07:28:30.849815+0000","last_active":"2024-04-26T07:28:33.848435+0000","last_peered":"2024-04-26T07:28:33.848435+0000","last_clean":"2024-04-26T07:28:33.848435+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:28:33.848435+0000","last_undegraded":"2024-04-26T07:28:33.848435+0000","last_fullsized":"2024-04-26T07:28:33.848435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138036+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:32.138036+0000","last_peered":"2024-04-26T07:28:32.138036+0000","last_clean":"2024-04-26T07:28:32.138036+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:32.138036+0000","last_undegraded":"2024-04-26T07:28:32.138036+0000","last_fullsized":"2024-04-26T07:28:32.138036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'16","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:48.306404+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:29:48.306404+0000","last_peered":"2024-04-26T07:29:48.306404+0000","last_clean":"2024-04-26T07:29:48.306404+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:29:48.306404+0000","last_undegraded":"2024-04-26T07:29:48.306404+0000","last_fullsized":"2024-04-26T07:29:48.306404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140996+0000","last_change":"2024-04-26T07:28:31.165872+0000","last_active":"2024-04-26T07:28:32.140996+0000","last_peered":"2024-04-26T07:28:32.140996+0000","last_clean":"2024-04-26T07:28:32.140996+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:28:32.140996+0000","last_undegraded":"2024-04-26T07:28:32.140996+0000","last_fullsized":"2024-04-26T07:28:32.140996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849427+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:33.849427+0000","last_peered":"2024-04-26T07:28:33.849427+0000","last_clean":"2024-04-26T07:28:33.849427+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:33.849427+0000","last_undegraded":"2024-04-26T07:28:33.849427+0000","last_fullsized":"2024-04-26T07:28:33.849427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137836+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:32.137836+0000","last_peered":"2024-04-26T07:28:32.137836+0000","last_clean":"2024-04-26T07:28:32.137836+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:32.137836+0000","last_undegraded":"2024-04-26T07:28:32.137836+0000","last_fullsized":"2024-04-26T07:28:32.137836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848622+0000","last_change":"2024-04-26T07:28:30.847060+0000","last_active":"2024-04-26T07:28:33.848622+0000","last_peered":"2024-04-26T07:28:33.848622+0000","last_clean":"2024-04-26T07:28:33.848622+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:28:33.848622+0000","last_undegraded":"2024-04-26T07:28:33.848622+0000","last_fullsized":"2024-04-26T07:28:33.848622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139915+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:32.139915+0000","last_peered":"2024-04-26T07:28:32.139915+0000","last_clean":"2024-04-26T07:28:32.139915+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:32.139915+0000","last_undegraded":"2024-04-26T07:28:32.139915+0000","last_fullsized":"2024-04-26T07:28:32.139915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138176+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:32.138176+0000","last_peered":"2024-04-26T07:28:32.138176+0000","last_clean":"2024-04-26T07:28:32.138176+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:32.138176+0000","last_undegraded":"2024-04-26T07:28:32.138176+0000","last_fullsized":"2024-04-26T07:28:32.138176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143072+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:32.143072+0000","last_peered":"2024-04-26T07:28:32.143072+0000","last_clean":"2024-04-26T07:28:32.143072+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:32.143072+0000","last_undegraded":"2024-04-26T07:28:32.143072+0000","last_fullsized":"2024-04-26T07:28:32.143072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847755+0000","last_change":"2024-04-26T07:28:30.839424+0000","last_active":"2024-04-26T07:28:33.847755+0000","last_peered":"2024-04-26T07:28:33.847755+0000","last_clean":"2024-04-26T07:28:33.847755+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:28:33.847755+0000","last_undegraded":"2024-04-26T07:28:33.847755+0000","last_fullsized":"2024-04-26T07:28:33.847755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139763+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:32.139763+0000","last_peered":"2024-04-26T07:28:32.139763+0000","last_clean":"2024-04-26T07:28:32.139763+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:32.139763+0000","last_undegraded":"2024-04-26T07:28:32.139763+0000","last_fullsized":"2024-04-26T07:28:32.139763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142966+0000","last_change":"2024-04-26T07:28:30.849542+0000","last_active":"2024-04-26T07:28:32.142966+0000","last_peered":"2024-04-26T07:28:32.142966+0000","last_clean":"2024-04-26T07:28:32.142966+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:28:32.142966+0000","last_undegraded":"2024-04-26T07:28:32.142966+0000","last_fullsized":"2024-04-26T07:28:32.142966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137801+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:32.137801+0000","last_peered":"2024-04-26T07:28:32.137801+0000","last_clean":"2024-04-26T07:28:32.137801+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:32.137801+0000","last_undegraded":"2024-04-26T07:28:32.137801+0000","last_fullsized":"2024-04-26T07:28:32.137801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140598+0000","last_change":"2024-04-26T07:28:30.853399+0000","last_active":"2024-04-26T07:28:32.140598+0000","last_peered":"2024-04-26T07:28:32.140598+0000","last_clean":"2024-04-26T07:28:32.140598+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:28:32.140598+0000","last_undegraded":"2024-04-26T07:28:32.140598+0000","last_fullsized":"2024-04-26T07:28:32.140598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138273+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:32.138273+0000","last_peered":"2024-04-26T07:28:32.138273+0000","last_clean":"2024-04-26T07:28:32.138273+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:32.138273+0000","last_undegraded":"2024-04-26T07:28:32.138273+0000","last_fullsized":"2024-04-26T07:28:32.138273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140135+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:32.140135+0000","last_peered":"2024-04-26T07:28:32.140135+0000","last_clean":"2024-04-26T07:28:32.140135+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:32.140135+0000","last_undegraded":"2024-04-26T07:28:32.140135+0000","last_fullsized":"2024-04-26T07:28:32.140135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139559+0000","last_change":"2024-04-26T07:28:31.165065+0000","last_active":"2024-04-26T07:28:32.139559+0000","last_peered":"2024-04-26T07:28:32.139559+0000","last_clean":"2024-04-26T07:28:32.139559+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:28:32.139559+0000","last_undegraded":"2024-04-26T07:28:32.139559+0000","last_fullsized":"2024-04-26T07:28:32.139559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143103+0000","last_change":"2024-04-26T07:28:30.844998+0000","last_active":"2024-04-26T07:28:32.143103+0000","last_peered":"2024-04-26T07:28:32.143103+0000","last_clean":"2024-04-26T07:28:32.143103+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:28:32.143103+0000","last_undegraded":"2024-04-26T07:28:32.143103+0000","last_fullsized":"2024-04-26T07:28:32.143103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142942+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:32.142942+0000","last_peered":"2024-04-26T07:28:32.142942+0000","last_clean":"2024-04-26T07:28:32.142942+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:32.142942+0000","last_undegraded":"2024-04-26T07:28:32.142942+0000","last_fullsized":"2024-04-26T07:28:32.142942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849085+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:33.849085+0000","last_peered":"2024-04-26T07:28:33.849085+0000","last_clean":"2024-04-26T07:28:33.849085+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:33.849085+0000","last_undegraded":"2024-04-26T07:28:33.849085+0000","last_fullsized":"2024-04-26T07:28:33.849085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142971+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:32.142971+0000","last_peered":"2024-04-26T07:28:32.142971+0000","last_clean":"2024-04-26T07:28:32.142971+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:32.142971+0000","last_undegraded":"2024-04-26T07:28:32.142971+0000","last_fullsized":"2024-04-26T07:28:32.142971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.136266+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:57.136266+0000","last_peered":"2024-04-26T07:28:57.136266+0000","last_clean":"2024-04-26T07:28:57.136266+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:57.136266+0000","last_undegraded":"2024-04-26T07:28:57.136266+0000","last_fullsized":"2024-04-26T07:28:57.136266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140027+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:32.140027+0000","last_peered":"2024-04-26T07:28:32.140027+0000","last_clean":"2024-04-26T07:28:32.140027+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:32.140027+0000","last_undegraded":"2024-04-26T07:28:32.140027+0000","last_fullsized":"2024-04-26T07:28:32.140027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848748+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:33.848748+0000","last_peered":"2024-04-26T07:28:33.848748+0000","last_clean":"2024-04-26T07:28:33.848748+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:33.848748+0000","last_undegraded":"2024-04-26T07:28:33.848748+0000","last_fullsized":"2024-04-26T07:28:33.848748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140673+0000","last_change":"2024-04-26T07:28:31.164112+0000","last_active":"2024-04-26T07:28:32.140673+0000","last_peered":"2024-04-26T07:28:32.140673+0000","last_clean":"2024-04-26T07:28:32.140673+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:28:32.140673+0000","last_undegraded":"2024-04-26T07:28:32.140673+0000","last_fullsized":"2024-04-26T07:28:32.140673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849508+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:33.849508+0000","last_peered":"2024-04-26T07:28:33.849508+0000","last_clean":"2024-04-26T07:28:33.849508+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:33.849508+0000","last_undegraded":"2024-04-26T07:28:33.849508+0000","last_fullsized":"2024-04-26T07:28:33.849508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140916+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:32.140916+0000","last_peered":"2024-04-26T07:28:32.140916+0000","last_clean":"2024-04-26T07:28:32.140916+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:32.140916+0000","last_undegraded":"2024-04-26T07:28:32.140916+0000","last_fullsized":"2024-04-26T07:28:32.140916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138969+0000","last_change":"2024-04-26T07:28:22.650334+0000","last_active":"2024-04-26T07:28:32.138969+0000","last_peered":"2024-04-26T07:28:32.138969+0000","last_clean":"2024-04-26T07:28:32.138969+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:28:32.138969+0000","last_undegraded":"2024-04-26T07:28:32.138969+0000","last_fullsized":"2024-04-26T07:28:32.138969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848587+0000","last_change":"2024-04-26T07:28:30.851175+0000","last_active":"2024-04-26T07:28:33.848587+0000","last_peered":"2024-04-26T07:28:33.848587+0000","last_clean":"2024-04-26T07:28:33.848587+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:28:33.848587+0000","last_undegraded":"2024-04-26T07:28:33.848587+0000","last_fullsized":"2024-04-26T07:28:33.848587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137905+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.137905+0000","last_peered":"2024-04-26T07:28:32.137905+0000","last_clean":"2024-04-26T07:28:32.137905+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:32.137905+0000","last_undegraded":"2024-04-26T07:28:32.137905+0000","last_fullsized":"2024-04-26T07:28:32.137905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139162+0000","last_change":"2024-04-26T07:28:22.023450+0000","last_active":"2024-04-26T07:28:32.139162+0000","last_peered":"2024-04-26T07:28:32.139162+0000","last_clean":"2024-04-26T07:28:32.139162+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:28:32.139162+0000","last_undegraded":"2024-04-26T07:28:32.139162+0000","last_fullsized":"2024-04-26T07:28:32.139162+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:46.777814+0000","last_change":"2024-04-26T07:28:30.853616+0000","last_active":"2024-04-26T07:28:46.777814+0000","last_peered":"2024-04-26T07:28:46.777814+0000","last_clean":"2024-04-26T07:28:46.777814+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:28:46.777814+0000","last_undegraded":"2024-04-26T07:28:46.777814+0000","last_fullsized":"2024-04-26T07:28:46.777814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139154+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:32.139154+0000","last_peered":"2024-04-26T07:28:32.139154+0000","last_clean":"2024-04-26T07:28:32.139154+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:32.139154+0000","last_undegraded":"2024-04-26T07:28:32.139154+0000","last_fullsized":"2024-04-26T07:28:32.139154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139749+0000","last_change":"2024-04-26T07:28:22.024031+0000","last_active":"2024-04-26T07:28:32.139749+0000","last_peered":"2024-04-26T07:28:32.139749+0000","last_clean":"2024-04-26T07:28:32.139749+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:28:32.139749+0000","last_undegraded":"2024-04-26T07:28:32.139749+0000","last_fullsized":"2024-04-26T07:28:32.139749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.846746+0000","last_change":"2024-04-26T07:28:30.839738+0000","last_active":"2024-04-26T07:28:33.846746+0000","last_peered":"2024-04-26T07:28:33.846746+0000","last_clean":"2024-04-26T07:28:33.846746+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:28:33.846746+0000","last_undegraded":"2024-04-26T07:28:33.846746+0000","last_fullsized":"2024-04-26T07:28:33.846746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140827+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:32.140827+0000","last_peered":"2024-04-26T07:28:32.140827+0000","last_clean":"2024-04-26T07:28:32.140827+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:32.140827+0000","last_undegraded":"2024-04-26T07:28:32.140827+0000","last_fullsized":"2024-04-26T07:28:32.140827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137628+0000","last_change":"2024-04-26T07:28:22.023795+0000","last_active":"2024-04-26T07:28:32.137628+0000","last_peered":"2024-04-26T07:28:32.137628+0000","last_clean":"2024-04-26T07:28:32.137628+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:28:32.137628+0000","last_undegraded":"2024-04-26T07:28:32.137628+0000","last_fullsized":"2024-04-26T07:28:32.137628+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137893+0000","last_change":"2024-04-26T07:28:18.549478+0000","last_active":"2024-04-26T07:28:32.137893+0000","last_peered":"2024-04-26T07:28:32.137893+0000","last_clean":"2024-04-26T07:28:32.137893+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:28:32.137893+0000","last_undegraded":"2024-04-26T07:28:32.137893+0000","last_fullsized":"2024-04-26T07:28:32.137893+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_clean_scrub_stamp":"2024-04-26T07:28:14.971410+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138992+0000","last_change":"2024-04-26T07:28:30.859261+0000","last_active":"2024-04-26T07:28:32.138992+0000","last_peered":"2024-04-26T07:28:32.138992+0000","last_clean":"2024-04-26T07:28:32.138992+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:28:32.138992+0000","last_undegraded":"2024-04-26T07:28:32.138992+0000","last_fullsized":"2024-04-26T07:28:32.138992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140556+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:32.140556+0000","last_peered":"2024-04-26T07:28:32.140556+0000","last_clean":"2024-04-26T07:28:32.140556+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:32.140556+0000","last_undegraded":"2024-04-26T07:28:32.140556+0000","last_fullsized":"2024-04-26T07:28:32.140556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137311+0000","last_change":"2024-04-26T07:28:22.026306+0000","last_active":"2024-04-26T07:28:32.137311+0000","last_peered":"2024-04-26T07:28:32.137311+0000","last_clean":"2024-04-26T07:28:32.137311+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:28:32.137311+0000","last_undegraded":"2024-04-26T07:28:32.137311+0000","last_fullsized":"2024-04-26T07:28:32.137311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847145+0000","last_change":"2024-04-26T07:28:30.854930+0000","last_active":"2024-04-26T07:28:33.847145+0000","last_peered":"2024-04-26T07:28:33.847145+0000","last_clean":"2024-04-26T07:28:33.847145+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:28:33.847145+0000","last_undegraded":"2024-04-26T07:28:33.847145+0000","last_fullsized":"2024-04-26T07:28:33.847145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143152+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:32.143152+0000","last_peered":"2024-04-26T07:28:32.143152+0000","last_clean":"2024-04-26T07:28:32.143152+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:32.143152+0000","last_undegraded":"2024-04-26T07:28:32.143152+0000","last_fullsized":"2024-04-26T07:28:32.143152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140322+0000","last_change":"2024-04-26T07:28:22.650352+0000","last_active":"2024-04-26T07:28:32.140322+0000","last_peered":"2024-04-26T07:28:32.140322+0000","last_clean":"2024-04-26T07:28:32.140322+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:28:32.140322+0000","last_undegraded":"2024-04-26T07:28:32.140322+0000","last_fullsized":"2024-04-26T07:28:32.140322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138450+0000","last_change":"2024-04-26T07:28:30.844050+0000","last_active":"2024-04-26T07:28:32.138450+0000","last_peered":"2024-04-26T07:28:32.138450+0000","last_clean":"2024-04-26T07:28:32.138450+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:28:32.138450+0000","last_undegraded":"2024-04-26T07:28:32.138450+0000","last_fullsized":"2024-04-26T07:28:32.138450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142850+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:32.142850+0000","last_peered":"2024-04-26T07:28:32.142850+0000","last_clean":"2024-04-26T07:28:32.142850+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:32.142850+0000","last_undegraded":"2024-04-26T07:28:32.142850+0000","last_fullsized":"2024-04-26T07:28:32.142850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848248+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:33.848248+0000","last_peered":"2024-04-26T07:28:33.848248+0000","last_clean":"2024-04-26T07:28:33.848248+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:33.848248+0000","last_undegraded":"2024-04-26T07:28:33.848248+0000","last_fullsized":"2024-04-26T07:28:33.848248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138741+0000","last_change":"2024-04-26T07:28:22.650310+0000","last_active":"2024-04-26T07:28:32.138741+0000","last_peered":"2024-04-26T07:28:32.138741+0000","last_clean":"2024-04-26T07:28:32.138741+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:28:32.138741+0000","last_undegraded":"2024-04-26T07:28:32.138741+0000","last_fullsized":"2024-04-26T07:28:32.138741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137320+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:32.137320+0000","last_peered":"2024-04-26T07:28:32.137320+0000","last_clean":"2024-04-26T07:28:32.137320+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:32.137320+0000","last_undegraded":"2024-04-26T07:28:32.137320+0000","last_fullsized":"2024-04-26T07:28:32.137320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139639+0000","last_change":"2024-04-26T07:28:22.650378+0000","last_active":"2024-04-26T07:28:32.139639+0000","last_peered":"2024-04-26T07:28:32.139639+0000","last_clean":"2024-04-26T07:28:32.139639+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:28:32.139639+0000","last_undegraded":"2024-04-26T07:28:32.139639+0000","last_fullsized":"2024-04-26T07:28:32.139639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:52.140606+0000","last_change":"2024-04-26T07:28:30.848849+0000","last_active":"2024-04-26T07:28:52.140606+0000","last_peered":"2024-04-26T07:28:52.140606+0000","last_clean":"2024-04-26T07:28:52.140606+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:28:52.140606+0000","last_undegraded":"2024-04-26T07:28:52.140606+0000","last_fullsized":"2024-04-26T07:28:52.140606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139591+0000","last_change":"2024-04-26T07:28:31.160967+0000","last_active":"2024-04-26T07:28:32.139591+0000","last_peered":"2024-04-26T07:28:32.139591+0000","last_clean":"2024-04-26T07:28:32.139591+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:28:32.139591+0000","last_undegraded":"2024-04-26T07:28:32.139591+0000","last_fullsized":"2024-04-26T07:28:32.139591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'10","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.139239+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:57.139239+0000","last_peered":"2024-04-26T07:28:57.139239+0000","last_clean":"2024-04-26T07:28:57.139239+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:57.139239+0000","last_undegraded":"2024-04-26T07:28:57.139239+0000","last_fullsized":"2024-04-26T07:28:57.139239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140278+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:32.140278+0000","last_peered":"2024-04-26T07:28:32.140278+0000","last_clean":"2024-04-26T07:28:32.140278+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:32.140278+0000","last_undegraded":"2024-04-26T07:28:32.140278+0000","last_fullsized":"2024-04-26T07:28:32.140278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138737+0000","last_change":"2024-04-26T07:28:30.852699+0000","last_active":"2024-04-26T07:28:32.138737+0000","last_peered":"2024-04-26T07:28:32.138737+0000","last_clean":"2024-04-26T07:28:32.138737+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:28:32.138737+0000","last_undegraded":"2024-04-26T07:28:32.138737+0000","last_fullsized":"2024-04-26T07:28:32.138737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140941+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:32.140941+0000","last_peered":"2024-04-26T07:28:32.140941+0000","last_clean":"2024-04-26T07:28:32.140941+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:32.140941+0000","last_undegraded":"2024-04-26T07:28:32.140941+0000","last_fullsized":"2024-04-26T07:28:32.140941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140429+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:32.140429+0000","last_peered":"2024-04-26T07:28:32.140429+0000","last_clean":"2024-04-26T07:28:32.140429+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:32.140429+0000","last_undegraded":"2024-04-26T07:28:32.140429+0000","last_fullsized":"2024-04-26T07:28:32.140429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139495+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:32.139495+0000","last_peered":"2024-04-26T07:28:32.139495+0000","last_clean":"2024-04-26T07:28:32.139495+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:32.139495+0000","last_undegraded":"2024-04-26T07:28:32.139495+0000","last_fullsized":"2024-04-26T07:28:32.139495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138254+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:32.138254+0000","last_peered":"2024-04-26T07:28:32.138254+0000","last_clean":"2024-04-26T07:28:32.138254+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:32.138254+0000","last_undegraded":"2024-04-26T07:28:32.138254+0000","last_fullsized":"2024-04-26T07:28:32.138254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143222+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:32.143222+0000","last_peered":"2024-04-26T07:28:32.143222+0000","last_clean":"2024-04-26T07:28:32.143222+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:32.143222+0000","last_undegraded":"2024-04-26T07:28:32.143222+0000","last_fullsized":"2024-04-26T07:28:32.143222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139300+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:32.139300+0000","last_peered":"2024-04-26T07:28:32.139300+0000","last_clean":"2024-04-26T07:28:32.139300+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:32.139300+0000","last_undegraded":"2024-04-26T07:28:32.139300+0000","last_fullsized":"2024-04-26T07:28:32.139300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138401+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:32.138401+0000","last_peered":"2024-04-26T07:28:32.138401+0000","last_clean":"2024-04-26T07:28:32.138401+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:32.138401+0000","last_undegraded":"2024-04-26T07:28:32.138401+0000","last_fullsized":"2024-04-26T07:28:32.138401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143246+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:32.143246+0000","last_peered":"2024-04-26T07:28:32.143246+0000","last_clean":"2024-04-26T07:28:32.143246+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:32.143246+0000","last_undegraded":"2024-04-26T07:28:32.143246+0000","last_fullsized":"2024-04-26T07:28:32.143246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138871+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:32.138871+0000","last_peered":"2024-04-26T07:28:32.138871+0000","last_clean":"2024-04-26T07:28:32.138871+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:32.138871+0000","last_undegraded":"2024-04-26T07:28:32.138871+0000","last_fullsized":"2024-04-26T07:28:32.138871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705687,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.46899999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705688,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.371},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.34799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.21199999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.247},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"last":0.224},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.23599999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705687,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29699999999999999}]}]}]}} 2024-04-26T07:30:04.950 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:30:05.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.093+0000 7f27a7ac7700 1 Processor -- start 2024-04-26T07:30:05.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.093+0000 7f27a7ac7700 1 -- start start 2024-04-26T07:30:05.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.093+0000 7f27a7ac7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a0137a50 0x7f27a0137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.093+0000 7f27a7ac7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a009ff30 0x7f27a00a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.093+0000 7f27a7ac7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a0137620 con 0x7f27a00a3740 2024-04-26T07:30:05.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.093+0000 7f27a7ac7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00a4e20 con 0x7f27a009ff30 2024-04-26T07:30:05.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.093+0000 7f27a7ac7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0138320 con 0x7f27a0137a50 2024-04-26T07:30:05.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5062700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a009ff30 0x7f27a00a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5863700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a0137a50 0x7f27a0137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5062700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a009ff30 0x7f27a00a3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42422/0 (socket says 172.21.15.31:42422) 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a6064700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f27a00a3740 0x7f27a005b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60146/0 (socket says 172.21.15.31:60146) 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5062700 1 -- 172.21.15.31:0/2545550599 learned_addr learned my addr 172.21.15.31:0/2545550599 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5062700 1 -- 172.21.15.31:0/2545550599 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a0137a50 msgr2=0x7f27a0137e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5062700 1 --2- 172.21.15.31:0/2545550599 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a0137a50 0x7f27a0137e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5062700 1 -- 172.21.15.31:0/2545550599 >> v1:172.21.15.31:6789/0 conn(0x7f27a00a3740 legacy=0x7f27a005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a4861700 1 -- 172.21.15.31:0/2545550599 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891812824 0 0) 0x7f27a0137620 con 0x7f27a00a3740 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5062700 1 -- 172.21.15.31:0/2545550599 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a00a46a0 con 0x7f27a009ff30 2024-04-26T07:30:05.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5863700 1 --2- 172.21.15.31:0/2545550599 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a0137a50 0x7f27a0137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a5062700 1 --2- 172.21.15.31:0/2545550599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a009ff30 0x7f27a00a3250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f279c002f70 tx=0x7f279c006eb0).ready entity=mon.1 client_cookie=dfb4a84c9c5b8337 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a4861700 1 -- 172.21.15.31:0/2545550599 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279c00d570 con 0x7f27a009ff30 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a4861700 1 -- 172.21.15.31:0/2545550599 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c000e90 con 0x7f27a009ff30 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.094+0000 7f27a4861700 1 -- 172.21.15.31:0/2545550599 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279c00d8c0 con 0x7f27a009ff30 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.095+0000 7f27a7ac7700 1 -- 172.21.15.31:0/2545550599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a009ff30 msgr2=0x7f27a00a3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.095+0000 7f27a7ac7700 1 --2- 172.21.15.31:0/2545550599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a009ff30 0x7f27a00a3250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f279c002f70 tx=0x7f279c006eb0).stop 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.095+0000 7f27a7ac7700 1 -- 172.21.15.31:0/2545550599 shutdown_connections 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.095+0000 7f27a7ac7700 1 --2- 172.21.15.31:0/2545550599 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a0137a50 0x7f27a0137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.095+0000 7f27a7ac7700 1 --2- 172.21.15.31:0/2545550599 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a009ff30 0x7f27a00a3250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.095+0000 7f27a7ac7700 1 -- 172.21.15.31:0/2545550599 >> 172.21.15.31:0/2545550599 conn(0x7f27a0060ee0 msgr2=0x7f27a00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.095+0000 7f27a7ac7700 1 -- 172.21.15.31:0/2545550599 shutdown_connections 2024-04-26T07:30:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.095+0000 7f27a7ac7700 1 -- 172.21.15.31:0/2545550599 wait complete. 2024-04-26T07:30:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.096+0000 7f27a7ac7700 1 Processor -- start 2024-04-26T07:30:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.096+0000 7f27a7ac7700 1 -- start start 2024-04-26T07:30:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a7ac7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a009ff30 0x7f27a0146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a7ac7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a00a3740 0x7f27a0143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a7ac7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a0137a50 0x7f27a0143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a7ac7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0143210 con 0x7f27a0137a50 2024-04-26T07:30:05.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a7ac7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0147750 con 0x7f27a00a3740 2024-04-26T07:30:05.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a7ac7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0066010 con 0x7f27a009ff30 2024-04-26T07:30:05.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a009ff30 0x7f27a0146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a009ff30 0x7f27a0146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:58948/0 (socket says 172.21.15.31:58948) 2024-04-26T07:30:05.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5062700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a00a3740 0x7f27a0143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 -- 172.21.15.31:0/1554393465 learned_addr learned my addr 172.21.15.31:0/1554393465 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:05.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a6064700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a0137a50 0x7f27a0143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 -- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a00a3740 msgr2=0x7f27a0143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a00a3740 0x7f27a0143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 -- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a0137a50 msgr2=0x7f27a0143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a0137a50 0x7f27a0143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 -- 172.21.15.31:0/1554393465 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279000b180 con 0x7f27a009ff30 2024-04-26T07:30:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5062700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a00a3740 0x7f27a0143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a6064700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a0137a50 0x7f27a0143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-26T07:30:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a5863700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a009ff30 0x7f27a0146ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f27a0066510 tx=0x7f2790006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f278effd700 1 -- 172.21.15.31:0/1554393465 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279000c7a0 con 0x7f27a009ff30 2024-04-26T07:30:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f278effd700 1 -- 172.21.15.31:0/1554393465 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279000c900 con 0x7f27a009ff30 2024-04-26T07:30:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c00b1e0 con 0x7f27a009ff30 2024-04-26T07:30:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f278effd700 1 -- 172.21.15.31:0/1554393465 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f279000cc60 con 0x7f27a009ff30 2024-04-26T07:30:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.097+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a0065dd0 con 0x7f27a009ff30 2024-04-26T07:30:05.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.098+0000 7f278effd700 1 -- 172.21.15.31:0/1554393465 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f279001c460 con 0x7f27a009ff30 2024-04-26T07:30:05.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.099+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a00a0350 con 0x7f27a009ff30 2024-04-26T07:30:05.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.099+0000 7f278effd700 1 -- 172.21.15.31:0/1554393465 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f279004adb0 con 0x7f27a009ff30 2024-04-26T07:30:05.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.102+0000 7f278effd700 1 -- 172.21.15.31:0/1554393465 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f27900336e0 con 0x7f27a009ff30 2024-04-26T07:30:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.214+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27a01441d0 con 0x7f2780038ec0 2024-04-26T07:30:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.221+0000 7f278effd700 1 -- 172.21.15.31:0/1554393465 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252030 (unknown 2965378022 0 2259004093) 0x7f27a01441d0 con 0x7f2780038ec0 2024-04-26T07:30:05.224 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:30:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 >> v1:172.21.15.31:6816/39613 conn(0x7f2780038ec0 legacy=0x7f278003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a009ff30 msgr2=0x7f27a0146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a009ff30 0x7f27a0146ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f27a0066510 tx=0x7f2790006df0).stop 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 shutdown_connections 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f27a009ff30 0x7f27a0146ac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a0137a50 0x7f27a0143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 --2- 172.21.15.31:0/1554393465 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27a00a3740 0x7f27a0143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 >> 172.21.15.31:0/1554393465 conn(0x7f27a0060ee0 msgr2=0x7f27a005c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.223+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 shutdown_connections 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.224+0000 7f27a7ac7700 1 -- 172.21.15.31:0/1554393465 wait complete. 2024-04-26T07:30:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:30:05.234 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-26T07:30:03.995195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002696"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140126+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:32.140126+0000","last_peered":"2024-04-26T07:28:32.140126+0000","last_clean":"2024-04-26T07:28:32.140126+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:32.140126+0000","last_undegraded":"2024-04-26T07:28:32.140126+0000","last_fullsized":"2024-04-26T07:28:32.140126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140737+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:32.140737+0000","last_peered":"2024-04-26T07:28:32.140737+0000","last_clean":"2024-04-26T07:28:32.140737+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:32.140737+0000","last_undegraded":"2024-04-26T07:28:32.140737+0000","last_fullsized":"2024-04-26T07:28:32.140737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143288+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:32.143288+0000","last_peered":"2024-04-26T07:28:32.143288+0000","last_clean":"2024-04-26T07:28:32.143288+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:32.143288+0000","last_undegraded":"2024-04-26T07:28:32.143288+0000","last_fullsized":"2024-04-26T07:28:32.143288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143164+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:32.143164+0000","last_peered":"2024-04-26T07:28:32.143164+0000","last_clean":"2024-04-26T07:28:32.143164+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:32.143164+0000","last_undegraded":"2024-04-26T07:28:32.143164+0000","last_fullsized":"2024-04-26T07:28:32.143164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142620+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:32.142620+0000","last_peered":"2024-04-26T07:28:32.142620+0000","last_clean":"2024-04-26T07:28:32.142620+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:32.142620+0000","last_undegraded":"2024-04-26T07:28:32.142620+0000","last_fullsized":"2024-04-26T07:28:32.142620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137729+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:32.137729+0000","last_peered":"2024-04-26T07:28:32.137729+0000","last_clean":"2024-04-26T07:28:32.137729+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:32.137729+0000","last_undegraded":"2024-04-26T07:28:32.137729+0000","last_fullsized":"2024-04-26T07:28:32.137729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143368+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:32.143368+0000","last_peered":"2024-04-26T07:28:32.143368+0000","last_clean":"2024-04-26T07:28:32.143368+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:32.143368+0000","last_undegraded":"2024-04-26T07:28:32.143368+0000","last_fullsized":"2024-04-26T07:28:32.143368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138820+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:32.138820+0000","last_peered":"2024-04-26T07:28:32.138820+0000","last_clean":"2024-04-26T07:28:32.138820+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:32.138820+0000","last_undegraded":"2024-04-26T07:28:32.138820+0000","last_fullsized":"2024-04-26T07:28:32.138820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138789+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:32.138789+0000","last_peered":"2024-04-26T07:28:32.138789+0000","last_clean":"2024-04-26T07:28:32.138789+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:32.138789+0000","last_undegraded":"2024-04-26T07:28:32.138789+0000","last_fullsized":"2024-04-26T07:28:32.138789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140217+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:32.140217+0000","last_peered":"2024-04-26T07:28:32.140217+0000","last_clean":"2024-04-26T07:28:32.140217+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:32.140217+0000","last_undegraded":"2024-04-26T07:28:32.140217+0000","last_fullsized":"2024-04-26T07:28:32.140217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140887+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:32.140887+0000","last_peered":"2024-04-26T07:28:32.140887+0000","last_clean":"2024-04-26T07:28:32.140887+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:32.140887+0000","last_undegraded":"2024-04-26T07:28:32.140887+0000","last_fullsized":"2024-04-26T07:28:32.140887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138879+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:32.138879+0000","last_peered":"2024-04-26T07:28:32.138879+0000","last_clean":"2024-04-26T07:28:32.138879+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:32.138879+0000","last_undegraded":"2024-04-26T07:28:32.138879+0000","last_fullsized":"2024-04-26T07:28:32.138879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142710+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:32.142710+0000","last_peered":"2024-04-26T07:28:32.142710+0000","last_clean":"2024-04-26T07:28:32.142710+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:32.142710+0000","last_undegraded":"2024-04-26T07:28:32.142710+0000","last_fullsized":"2024-04-26T07:28:32.142710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143257+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:32.143257+0000","last_peered":"2024-04-26T07:28:32.143257+0000","last_clean":"2024-04-26T07:28:32.143257+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:32.143257+0000","last_undegraded":"2024-04-26T07:28:32.143257+0000","last_fullsized":"2024-04-26T07:28:32.143257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142802+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:32.142802+0000","last_peered":"2024-04-26T07:28:32.142802+0000","last_clean":"2024-04-26T07:28:32.142802+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:32.142802+0000","last_undegraded":"2024-04-26T07:28:32.142802+0000","last_fullsized":"2024-04-26T07:28:32.142802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139998+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:32.139998+0000","last_peered":"2024-04-26T07:28:32.139998+0000","last_clean":"2024-04-26T07:28:32.139998+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:32.139998+0000","last_undegraded":"2024-04-26T07:28:32.139998+0000","last_fullsized":"2024-04-26T07:28:32.139998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139079+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:32.139079+0000","last_peered":"2024-04-26T07:28:32.139079+0000","last_clean":"2024-04-26T07:28:32.139079+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:32.139079+0000","last_undegraded":"2024-04-26T07:28:32.139079+0000","last_fullsized":"2024-04-26T07:28:32.139079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138354+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.138354+0000","last_peered":"2024-04-26T07:28:32.138354+0000","last_clean":"2024-04-26T07:28:32.138354+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:32.138354+0000","last_undegraded":"2024-04-26T07:28:32.138354+0000","last_fullsized":"2024-04-26T07:28:32.138354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142486+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:32.142486+0000","last_peered":"2024-04-26T07:28:32.142486+0000","last_clean":"2024-04-26T07:28:32.142486+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:32.142486+0000","last_undegraded":"2024-04-26T07:28:32.142486+0000","last_fullsized":"2024-04-26T07:28:32.142486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137844+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:32.137844+0000","last_peered":"2024-04-26T07:28:32.137844+0000","last_clean":"2024-04-26T07:28:32.137844+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:32.137844+0000","last_undegraded":"2024-04-26T07:28:32.137844+0000","last_fullsized":"2024-04-26T07:28:32.137844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140794+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.140794+0000","last_peered":"2024-04-26T07:28:32.140794+0000","last_clean":"2024-04-26T07:28:32.140794+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:32.140794+0000","last_undegraded":"2024-04-26T07:28:32.140794+0000","last_fullsized":"2024-04-26T07:28:32.140794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138683+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:32.138683+0000","last_peered":"2024-04-26T07:28:32.138683+0000","last_clean":"2024-04-26T07:28:32.138683+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:32.138683+0000","last_undegraded":"2024-04-26T07:28:32.138683+0000","last_fullsized":"2024-04-26T07:28:32.138683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137704+0000","last_change":"2024-04-26T07:28:30.838970+0000","last_active":"2024-04-26T07:28:32.137704+0000","last_peered":"2024-04-26T07:28:32.137704+0000","last_clean":"2024-04-26T07:28:32.137704+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:28:32.137704+0000","last_undegraded":"2024-04-26T07:28:32.137704+0000","last_fullsized":"2024-04-26T07:28:32.137704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138132+0000","last_change":"2024-04-26T07:28:30.845233+0000","last_active":"2024-04-26T07:28:32.138132+0000","last_peered":"2024-04-26T07:28:32.138132+0000","last_clean":"2024-04-26T07:28:32.138132+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:28:32.138132+0000","last_undegraded":"2024-04-26T07:28:32.138132+0000","last_fullsized":"2024-04-26T07:28:32.138132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142948+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:32.142948+0000","last_peered":"2024-04-26T07:28:32.142948+0000","last_clean":"2024-04-26T07:28:32.142948+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:32.142948+0000","last_undegraded":"2024-04-26T07:28:32.142948+0000","last_fullsized":"2024-04-26T07:28:32.142948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847320+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:33.847320+0000","last_peered":"2024-04-26T07:28:33.847320+0000","last_clean":"2024-04-26T07:28:33.847320+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:33.847320+0000","last_undegraded":"2024-04-26T07:28:33.847320+0000","last_fullsized":"2024-04-26T07:28:33.847320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'7","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:12.136901+0000","last_change":"2024-04-26T07:28:30.850023+0000","last_active":"2024-04-26T07:29:12.136901+0000","last_peered":"2024-04-26T07:29:12.136901+0000","last_clean":"2024-04-26T07:29:12.136901+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:29:12.136901+0000","last_undegraded":"2024-04-26T07:29:12.136901+0000","last_fullsized":"2024-04-26T07:29:12.136901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137664+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:32.137664+0000","last_peered":"2024-04-26T07:28:32.137664+0000","last_clean":"2024-04-26T07:28:32.137664+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:32.137664+0000","last_undegraded":"2024-04-26T07:28:32.137664+0000","last_fullsized":"2024-04-26T07:28:32.137664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848610+0000","last_change":"2024-04-26T07:28:30.853633+0000","last_active":"2024-04-26T07:28:33.848610+0000","last_peered":"2024-04-26T07:28:33.848610+0000","last_clean":"2024-04-26T07:28:33.848610+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:28:33.848610+0000","last_undegraded":"2024-04-26T07:28:33.848610+0000","last_fullsized":"2024-04-26T07:28:33.848610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138363+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:32.138363+0000","last_peered":"2024-04-26T07:28:32.138363+0000","last_clean":"2024-04-26T07:28:32.138363+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:32.138363+0000","last_undegraded":"2024-04-26T07:28:32.138363+0000","last_fullsized":"2024-04-26T07:28:32.138363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848435+0000","last_change":"2024-04-26T07:28:30.849815+0000","last_active":"2024-04-26T07:28:33.848435+0000","last_peered":"2024-04-26T07:28:33.848435+0000","last_clean":"2024-04-26T07:28:33.848435+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:28:33.848435+0000","last_undegraded":"2024-04-26T07:28:33.848435+0000","last_fullsized":"2024-04-26T07:28:33.848435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138036+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:32.138036+0000","last_peered":"2024-04-26T07:28:32.138036+0000","last_clean":"2024-04-26T07:28:32.138036+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:32.138036+0000","last_undegraded":"2024-04-26T07:28:32.138036+0000","last_fullsized":"2024-04-26T07:28:32.138036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'16","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:48.306404+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:29:48.306404+0000","last_peered":"2024-04-26T07:29:48.306404+0000","last_clean":"2024-04-26T07:29:48.306404+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:29:48.306404+0000","last_undegraded":"2024-04-26T07:29:48.306404+0000","last_fullsized":"2024-04-26T07:29:48.306404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140996+0000","last_change":"2024-04-26T07:28:31.165872+0000","last_active":"2024-04-26T07:28:32.140996+0000","last_peered":"2024-04-26T07:28:32.140996+0000","last_clean":"2024-04-26T07:28:32.140996+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:28:32.140996+0000","last_undegraded":"2024-04-26T07:28:32.140996+0000","last_fullsized":"2024-04-26T07:28:32.140996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849427+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:33.849427+0000","last_peered":"2024-04-26T07:28:33.849427+0000","last_clean":"2024-04-26T07:28:33.849427+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:33.849427+0000","last_undegraded":"2024-04-26T07:28:33.849427+0000","last_fullsized":"2024-04-26T07:28:33.849427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137836+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:32.137836+0000","last_peered":"2024-04-26T07:28:32.137836+0000","last_clean":"2024-04-26T07:28:32.137836+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:32.137836+0000","last_undegraded":"2024-04-26T07:28:32.137836+0000","last_fullsized":"2024-04-26T07:28:32.137836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848622+0000","last_change":"2024-04-26T07:28:30.847060+0000","last_active":"2024-04-26T07:28:33.848622+0000","last_peered":"2024-04-26T07:28:33.848622+0000","last_clean":"2024-04-26T07:28:33.848622+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:28:33.848622+0000","last_undegraded":"2024-04-26T07:28:33.848622+0000","last_fullsized":"2024-04-26T07:28:33.848622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139915+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:32.139915+0000","last_peered":"2024-04-26T07:28:32.139915+0000","last_clean":"2024-04-26T07:28:32.139915+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:32.139915+0000","last_undegraded":"2024-04-26T07:28:32.139915+0000","last_fullsized":"2024-04-26T07:28:32.139915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138176+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:32.138176+0000","last_peered":"2024-04-26T07:28:32.138176+0000","last_clean":"2024-04-26T07:28:32.138176+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:32.138176+0000","last_undegraded":"2024-04-26T07:28:32.138176+0000","last_fullsized":"2024-04-26T07:28:32.138176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143072+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:32.143072+0000","last_peered":"2024-04-26T07:28:32.143072+0000","last_clean":"2024-04-26T07:28:32.143072+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:32.143072+0000","last_undegraded":"2024-04-26T07:28:32.143072+0000","last_fullsized":"2024-04-26T07:28:32.143072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847755+0000","last_change":"2024-04-26T07:28:30.839424+0000","last_active":"2024-04-26T07:28:33.847755+0000","last_peered":"2024-04-26T07:28:33.847755+0000","last_clean":"2024-04-26T07:28:33.847755+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:28:33.847755+0000","last_undegraded":"2024-04-26T07:28:33.847755+0000","last_fullsized":"2024-04-26T07:28:33.847755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139763+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:32.139763+0000","last_peered":"2024-04-26T07:28:32.139763+0000","last_clean":"2024-04-26T07:28:32.139763+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:32.139763+0000","last_undegraded":"2024-04-26T07:28:32.139763+0000","last_fullsized":"2024-04-26T07:28:32.139763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142966+0000","last_change":"2024-04-26T07:28:30.849542+0000","last_active":"2024-04-26T07:28:32.142966+0000","last_peered":"2024-04-26T07:28:32.142966+0000","last_clean":"2024-04-26T07:28:32.142966+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:28:32.142966+0000","last_undegraded":"2024-04-26T07:28:32.142966+0000","last_fullsized":"2024-04-26T07:28:32.142966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137801+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:32.137801+0000","last_peered":"2024-04-26T07:28:32.137801+0000","last_clean":"2024-04-26T07:28:32.137801+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:32.137801+0000","last_undegraded":"2024-04-26T07:28:32.137801+0000","last_fullsized":"2024-04-26T07:28:32.137801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140598+0000","last_change":"2024-04-26T07:28:30.853399+0000","last_active":"2024-04-26T07:28:32.140598+0000","last_peered":"2024-04-26T07:28:32.140598+0000","last_clean":"2024-04-26T07:28:32.140598+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:28:32.140598+0000","last_undegraded":"2024-04-26T07:28:32.140598+0000","last_fullsized":"2024-04-26T07:28:32.140598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138273+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:32.138273+0000","last_peered":"2024-04-26T07:28:32.138273+0000","last_clean":"2024-04-26T07:28:32.138273+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:32.138273+0000","last_undegraded":"2024-04-26T07:28:32.138273+0000","last_fullsized":"2024-04-26T07:28:32.138273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140135+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:32.140135+0000","last_peered":"2024-04-26T07:28:32.140135+0000","last_clean":"2024-04-26T07:28:32.140135+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:32.140135+0000","last_undegraded":"2024-04-26T07:28:32.140135+0000","last_fullsized":"2024-04-26T07:28:32.140135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139559+0000","last_change":"2024-04-26T07:28:31.165065+0000","last_active":"2024-04-26T07:28:32.139559+0000","last_peered":"2024-04-26T07:28:32.139559+0000","last_clean":"2024-04-26T07:28:32.139559+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:28:32.139559+0000","last_undegraded":"2024-04-26T07:28:32.139559+0000","last_fullsized":"2024-04-26T07:28:32.139559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143103+0000","last_change":"2024-04-26T07:28:30.844998+0000","last_active":"2024-04-26T07:28:32.143103+0000","last_peered":"2024-04-26T07:28:32.143103+0000","last_clean":"2024-04-26T07:28:32.143103+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:28:32.143103+0000","last_undegraded":"2024-04-26T07:28:32.143103+0000","last_fullsized":"2024-04-26T07:28:32.143103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142942+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:32.142942+0000","last_peered":"2024-04-26T07:28:32.142942+0000","last_clean":"2024-04-26T07:28:32.142942+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:32.142942+0000","last_undegraded":"2024-04-26T07:28:32.142942+0000","last_fullsized":"2024-04-26T07:28:32.142942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849085+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:33.849085+0000","last_peered":"2024-04-26T07:28:33.849085+0000","last_clean":"2024-04-26T07:28:33.849085+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:33.849085+0000","last_undegraded":"2024-04-26T07:28:33.849085+0000","last_fullsized":"2024-04-26T07:28:33.849085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142971+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:32.142971+0000","last_peered":"2024-04-26T07:28:32.142971+0000","last_clean":"2024-04-26T07:28:32.142971+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:32.142971+0000","last_undegraded":"2024-04-26T07:28:32.142971+0000","last_fullsized":"2024-04-26T07:28:32.142971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.136266+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:57.136266+0000","last_peered":"2024-04-26T07:28:57.136266+0000","last_clean":"2024-04-26T07:28:57.136266+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:57.136266+0000","last_undegraded":"2024-04-26T07:28:57.136266+0000","last_fullsized":"2024-04-26T07:28:57.136266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140027+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:32.140027+0000","last_peered":"2024-04-26T07:28:32.140027+0000","last_clean":"2024-04-26T07:28:32.140027+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:32.140027+0000","last_undegraded":"2024-04-26T07:28:32.140027+0000","last_fullsized":"2024-04-26T07:28:32.140027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848748+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:33.848748+0000","last_peered":"2024-04-26T07:28:33.848748+0000","last_clean":"2024-04-26T07:28:33.848748+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:33.848748+0000","last_undegraded":"2024-04-26T07:28:33.848748+0000","last_fullsized":"2024-04-26T07:28:33.848748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140673+0000","last_change":"2024-04-26T07:28:31.164112+0000","last_active":"2024-04-26T07:28:32.140673+0000","last_peered":"2024-04-26T07:28:32.140673+0000","last_clean":"2024-04-26T07:28:32.140673+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:28:32.140673+0000","last_undegraded":"2024-04-26T07:28:32.140673+0000","last_fullsized":"2024-04-26T07:28:32.140673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849508+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:33.849508+0000","last_peered":"2024-04-26T07:28:33.849508+0000","last_clean":"2024-04-26T07:28:33.849508+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:33.849508+0000","last_undegraded":"2024-04-26T07:28:33.849508+0000","last_fullsized":"2024-04-26T07:28:33.849508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140916+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:32.140916+0000","last_peered":"2024-04-26T07:28:32.140916+0000","last_clean":"2024-04-26T07:28:32.140916+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:32.140916+0000","last_undegraded":"2024-04-26T07:28:32.140916+0000","last_fullsized":"2024-04-26T07:28:32.140916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138969+0000","last_change":"2024-04-26T07:28:22.650334+0000","last_active":"2024-04-26T07:28:32.138969+0000","last_peered":"2024-04-26T07:28:32.138969+0000","last_clean":"2024-04-26T07:28:32.138969+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:28:32.138969+0000","last_undegraded":"2024-04-26T07:28:32.138969+0000","last_fullsized":"2024-04-26T07:28:32.138969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848587+0000","last_change":"2024-04-26T07:28:30.851175+0000","last_active":"2024-04-26T07:28:33.848587+0000","last_peered":"2024-04-26T07:28:33.848587+0000","last_clean":"2024-04-26T07:28:33.848587+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:28:33.848587+0000","last_undegraded":"2024-04-26T07:28:33.848587+0000","last_fullsized":"2024-04-26T07:28:33.848587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137905+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.137905+0000","last_peered":"2024-04-26T07:28:32.137905+0000","last_clean":"2024-04-26T07:28:32.137905+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:32.137905+0000","last_undegraded":"2024-04-26T07:28:32.137905+0000","last_fullsized":"2024-04-26T07:28:32.137905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139162+0000","last_change":"2024-04-26T07:28:22.023450+0000","last_active":"2024-04-26T07:28:32.139162+0000","last_peered":"2024-04-26T07:28:32.139162+0000","last_clean":"2024-04-26T07:28:32.139162+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:28:32.139162+0000","last_undegraded":"2024-04-26T07:28:32.139162+0000","last_fullsized":"2024-04-26T07:28:32.139162+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:46.777814+0000","last_change":"2024-04-26T07:28:30.853616+0000","last_active":"2024-04-26T07:28:46.777814+0000","last_peered":"2024-04-26T07:28:46.777814+0000","last_clean":"2024-04-26T07:28:46.777814+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:28:46.777814+0000","last_undegraded":"2024-04-26T07:28:46.777814+0000","last_fullsized":"2024-04-26T07:28:46.777814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139154+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:32.139154+0000","last_peered":"2024-04-26T07:28:32.139154+0000","last_clean":"2024-04-26T07:28:32.139154+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:32.139154+0000","last_undegraded":"2024-04-26T07:28:32.139154+0000","last_fullsized":"2024-04-26T07:28:32.139154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139749+0000","last_change":"2024-04-26T07:28:22.024031+0000","last_active":"2024-04-26T07:28:32.139749+0000","last_peered":"2024-04-26T07:28:32.139749+0000","last_clean":"2024-04-26T07:28:32.139749+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:28:32.139749+0000","last_undegraded":"2024-04-26T07:28:32.139749+0000","last_fullsized":"2024-04-26T07:28:32.139749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.846746+0000","last_change":"2024-04-26T07:28:30.839738+0000","last_active":"2024-04-26T07:28:33.846746+0000","last_peered":"2024-04-26T07:28:33.846746+0000","last_clean":"2024-04-26T07:28:33.846746+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:28:33.846746+0000","last_undegraded":"2024-04-26T07:28:33.846746+0000","last_fullsized":"2024-04-26T07:28:33.846746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140827+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:32.140827+0000","last_peered":"2024-04-26T07:28:32.140827+0000","last_clean":"2024-04-26T07:28:32.140827+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:32.140827+0000","last_undegraded":"2024-04-26T07:28:32.140827+0000","last_fullsized":"2024-04-26T07:28:32.140827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137628+0000","last_change":"2024-04-26T07:28:22.023795+0000","last_active":"2024-04-26T07:28:32.137628+0000","last_peered":"2024-04-26T07:28:32.137628+0000","last_clean":"2024-04-26T07:28:32.137628+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:28:32.137628+0000","last_undegraded":"2024-04-26T07:28:32.137628+0000","last_fullsized":"2024-04-26T07:28:32.137628+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137893+0000","last_change":"2024-04-26T07:28:18.549478+0000","last_active":"2024-04-26T07:28:32.137893+0000","last_peered":"2024-04-26T07:28:32.137893+0000","last_clean":"2024-04-26T07:28:32.137893+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:28:32.137893+0000","last_undegraded":"2024-04-26T07:28:32.137893+0000","last_fullsized":"2024-04-26T07:28:32.137893+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_clean_scrub_stamp":"2024-04-26T07:28:14.971410+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138992+0000","last_change":"2024-04-26T07:28:30.859261+0000","last_active":"2024-04-26T07:28:32.138992+0000","last_peered":"2024-04-26T07:28:32.138992+0000","last_clean":"2024-04-26T07:28:32.138992+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:28:32.138992+0000","last_undegraded":"2024-04-26T07:28:32.138992+0000","last_fullsized":"2024-04-26T07:28:32.138992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140556+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:32.140556+0000","last_peered":"2024-04-26T07:28:32.140556+0000","last_clean":"2024-04-26T07:28:32.140556+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:32.140556+0000","last_undegraded":"2024-04-26T07:28:32.140556+0000","last_fullsized":"2024-04-26T07:28:32.140556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137311+0000","last_change":"2024-04-26T07:28:22.026306+0000","last_active":"2024-04-26T07:28:32.137311+0000","last_peered":"2024-04-26T07:28:32.137311+0000","last_clean":"2024-04-26T07:28:32.137311+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:28:32.137311+0000","last_undegraded":"2024-04-26T07:28:32.137311+0000","last_fullsized":"2024-04-26T07:28:32.137311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847145+0000","last_change":"2024-04-26T07:28:30.854930+0000","last_active":"2024-04-26T07:28:33.847145+0000","last_peered":"2024-04-26T07:28:33.847145+0000","last_clean":"2024-04-26T07:28:33.847145+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:28:33.847145+0000","last_undegraded":"2024-04-26T07:28:33.847145+0000","last_fullsized":"2024-04-26T07:28:33.847145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143152+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:32.143152+0000","last_peered":"2024-04-26T07:28:32.143152+0000","last_clean":"2024-04-26T07:28:32.143152+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:32.143152+0000","last_undegraded":"2024-04-26T07:28:32.143152+0000","last_fullsized":"2024-04-26T07:28:32.143152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140322+0000","last_change":"2024-04-26T07:28:22.650352+0000","last_active":"2024-04-26T07:28:32.140322+0000","last_peered":"2024-04-26T07:28:32.140322+0000","last_clean":"2024-04-26T07:28:32.140322+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:28:32.140322+0000","last_undegraded":"2024-04-26T07:28:32.140322+0000","last_fullsized":"2024-04-26T07:28:32.140322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138450+0000","last_change":"2024-04-26T07:28:30.844050+0000","last_active":"2024-04-26T07:28:32.138450+0000","last_peered":"2024-04-26T07:28:32.138450+0000","last_clean":"2024-04-26T07:28:32.138450+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:28:32.138450+0000","last_undegraded":"2024-04-26T07:28:32.138450+0000","last_fullsized":"2024-04-26T07:28:32.138450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142850+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:32.142850+0000","last_peered":"2024-04-26T07:28:32.142850+0000","last_clean":"2024-04-26T07:28:32.142850+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:32.142850+0000","last_undegraded":"2024-04-26T07:28:32.142850+0000","last_fullsized":"2024-04-26T07:28:32.142850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848248+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:33.848248+0000","last_peered":"2024-04-26T07:28:33.848248+0000","last_clean":"2024-04-26T07:28:33.848248+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:33.848248+0000","last_undegraded":"2024-04-26T07:28:33.848248+0000","last_fullsized":"2024-04-26T07:28:33.848248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138741+0000","last_change":"2024-04-26T07:28:22.650310+0000","last_active":"2024-04-26T07:28:32.138741+0000","last_peered":"2024-04-26T07:28:32.138741+0000","last_clean":"2024-04-26T07:28:32.138741+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:28:32.138741+0000","last_undegraded":"2024-04-26T07:28:32.138741+0000","last_fullsized":"2024-04-26T07:28:32.138741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137320+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:32.137320+0000","last_peered":"2024-04-26T07:28:32.137320+0000","last_clean":"2024-04-26T07:28:32.137320+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:32.137320+0000","last_undegraded":"2024-04-26T07:28:32.137320+0000","last_fullsized":"2024-04-26T07:28:32.137320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139639+0000","last_change":"2024-04-26T07:28:22.650378+0000","last_active":"2024-04-26T07:28:32.139639+0000","last_peered":"2024-04-26T07:28:32.139639+0000","last_clean":"2024-04-26T07:28:32.139639+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:28:32.139639+0000","last_undegraded":"2024-04-26T07:28:32.139639+0000","last_fullsized":"2024-04-26T07:28:32.139639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:52.140606+0000","last_change":"2024-04-26T07:28:30.848849+0000","last_active":"2024-04-26T07:28:52.140606+0000","last_peered":"2024-04-26T07:28:52.140606+0000","last_clean":"2024-04-26T07:28:52.140606+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:28:52.140606+0000","last_undegraded":"2024-04-26T07:28:52.140606+0000","last_fullsized":"2024-04-26T07:28:52.140606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139591+0000","last_change":"2024-04-26T07:28:31.160967+0000","last_active":"2024-04-26T07:28:32.139591+0000","last_peered":"2024-04-26T07:28:32.139591+0000","last_clean":"2024-04-26T07:28:32.139591+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:28:32.139591+0000","last_undegraded":"2024-04-26T07:28:32.139591+0000","last_fullsized":"2024-04-26T07:28:32.139591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'10","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.139239+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:57.139239+0000","last_peered":"2024-04-26T07:28:57.139239+0000","last_clean":"2024-04-26T07:28:57.139239+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:57.139239+0000","last_undegraded":"2024-04-26T07:28:57.139239+0000","last_fullsized":"2024-04-26T07:28:57.139239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140278+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:32.140278+0000","last_peered":"2024-04-26T07:28:32.140278+0000","last_clean":"2024-04-26T07:28:32.140278+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:32.140278+0000","last_undegraded":"2024-04-26T07:28:32.140278+0000","last_fullsized":"2024-04-26T07:28:32.140278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138737+0000","last_change":"2024-04-26T07:28:30.852699+0000","last_active":"2024-04-26T07:28:32.138737+0000","last_peered":"2024-04-26T07:28:32.138737+0000","last_clean":"2024-04-26T07:28:32.138737+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:28:32.138737+0000","last_undegraded":"2024-04-26T07:28:32.138737+0000","last_fullsized":"2024-04-26T07:28:32.138737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140941+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:32.140941+0000","last_peered":"2024-04-26T07:28:32.140941+0000","last_clean":"2024-04-26T07:28:32.140941+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:32.140941+0000","last_undegraded":"2024-04-26T07:28:32.140941+0000","last_fullsized":"2024-04-26T07:28:32.140941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140429+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:32.140429+0000","last_peered":"2024-04-26T07:28:32.140429+0000","last_clean":"2024-04-26T07:28:32.140429+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:32.140429+0000","last_undegraded":"2024-04-26T07:28:32.140429+0000","last_fullsized":"2024-04-26T07:28:32.140429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139495+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:32.139495+0000","last_peered":"2024-04-26T07:28:32.139495+0000","last_clean":"2024-04-26T07:28:32.139495+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:32.139495+0000","last_undegraded":"2024-04-26T07:28:32.139495+0000","last_fullsized":"2024-04-26T07:28:32.139495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138254+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:32.138254+0000","last_peered":"2024-04-26T07:28:32.138254+0000","last_clean":"2024-04-26T07:28:32.138254+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:32.138254+0000","last_undegraded":"2024-04-26T07:28:32.138254+0000","last_fullsized":"2024-04-26T07:28:32.138254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143222+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:32.143222+0000","last_peered":"2024-04-26T07:28:32.143222+0000","last_clean":"2024-04-26T07:28:32.143222+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:32.143222+0000","last_undegraded":"2024-04-26T07:28:32.143222+0000","last_fullsized":"2024-04-26T07:28:32.143222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139300+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:32.139300+0000","last_peered":"2024-04-26T07:28:32.139300+0000","last_clean":"2024-04-26T07:28:32.139300+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:32.139300+0000","last_undegraded":"2024-04-26T07:28:32.139300+0000","last_fullsized":"2024-04-26T07:28:32.139300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138401+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:32.138401+0000","last_peered":"2024-04-26T07:28:32.138401+0000","last_clean":"2024-04-26T07:28:32.138401+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:32.138401+0000","last_undegraded":"2024-04-26T07:28:32.138401+0000","last_fullsized":"2024-04-26T07:28:32.138401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143246+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:32.143246+0000","last_peered":"2024-04-26T07:28:32.143246+0000","last_clean":"2024-04-26T07:28:32.143246+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:32.143246+0000","last_undegraded":"2024-04-26T07:28:32.143246+0000","last_fullsized":"2024-04-26T07:28:32.143246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138871+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:32.138871+0000","last_peered":"2024-04-26T07:28:32.138871+0000","last_clean":"2024-04-26T07:28:32.138871+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:32.138871+0000","last_undegraded":"2024-04-26T07:28:32.138871+0000","last_fullsized":"2024-04-26T07:28:32.138871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705687,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.46899999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705688,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.371},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.34799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.21199999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.247},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"last":0.224},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.23599999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705687,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29699999999999999}]}]}]}} 2024-04-26T07:30:05.237 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T07:30:05.237 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:30:05.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.380+0000 7f560b528700 1 Processor -- start 2024-04-26T07:30:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.380+0000 7f560b528700 1 -- start start 2024-04-26T07:30:05.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f560b528700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56041335d0 0x7f56040679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f560b528700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f560413ea20 0x7f5604140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f560b528700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5604067ec0 con 0x7f56041339b0 2024-04-26T07:30:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f560b528700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56040670c0 con 0x7f560413ea20 2024-04-26T07:30:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f560b528700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5604066600 con 0x7f56041335d0 2024-04-26T07:30:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f56092c4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56041335d0 0x7f56040679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f5609ac5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f560413ea20 0x7f5604140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f5608ac3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f56041339b0 0x7f56040a43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60162/0 (socket says 172.21.15.31:60162) 2024-04-26T07:30:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f5608ac3700 1 -- 172.21.15.31:0/1959046727 learned_addr learned my addr 172.21.15.31:0/1959046727 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f55f3fff700 1 -- 172.21.15.31:0/1959046727 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589875937 0 0) 0x7f5604067ec0 con 0x7f56041339b0 2024-04-26T07:30:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f56092c4700 1 -- 172.21.15.31:0/1959046727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f560413ea20 msgr2=0x7f5604140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f56092c4700 1 --2- 172.21.15.31:0/1959046727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f560413ea20 0x7f5604140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f56092c4700 1 -- 172.21.15.31:0/1959046727 >> v1:172.21.15.31:6789/0 conn(0x7f56041339b0 legacy=0x7f56040a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f56092c4700 1 -- 172.21.15.31:0/1959046727 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604066de0 con 0x7f56041335d0 2024-04-26T07:30:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.381+0000 7f5609ac5700 1 --2- 172.21.15.31:0/1959046727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f560413ea20 0x7f5604140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f56092c4700 1 --2- 172.21.15.31:0/1959046727 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56041335d0 0x7f56040679d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f55f4002f70 tx=0x7f55f4006df0).ready entity=mon.2 client_cookie=8e1cbd224919b0ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f55f3fff700 1 -- 172.21.15.31:0/1959046727 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55f400d570 con 0x7f56041335d0 2024-04-26T07:30:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f55f3fff700 1 -- 172.21.15.31:0/1959046727 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f4000e90 con 0x7f56041335d0 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f55f3fff700 1 -- 172.21.15.31:0/1959046727 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55f400d8c0 con 0x7f56041335d0 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f560b528700 1 -- 172.21.15.31:0/1959046727 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56041335d0 msgr2=0x7f56040679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f560b528700 1 --2- 172.21.15.31:0/1959046727 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56041335d0 0x7f56040679d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f55f4002f70 tx=0x7f55f4006df0).stop 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f560b528700 1 -- 172.21.15.31:0/1959046727 shutdown_connections 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f560b528700 1 --2- 172.21.15.31:0/1959046727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f560413ea20 0x7f5604140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f560b528700 1 --2- 172.21.15.31:0/1959046727 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56041335d0 0x7f56040679d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f560b528700 1 -- 172.21.15.31:0/1959046727 >> 172.21.15.31:0/1959046727 conn(0x7f5604060ee0 msgr2=0x7f56040a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f560b528700 1 -- 172.21.15.31:0/1959046727 shutdown_connections 2024-04-26T07:30:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.382+0000 7f560b528700 1 -- 172.21.15.31:0/1959046727 wait complete. 2024-04-26T07:30:05.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.383+0000 7f560b528700 1 Processor -- start 2024-04-26T07:30:05.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.383+0000 7f560b528700 1 -- start start 2024-04-26T07:30:05.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f560b528700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56041335d0 0x7f5604136540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f560b528700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56041339b0 0x7f5604134980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f560b528700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f560413ea20 0x7f560409db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f560b528700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56041340a0 con 0x7f56041339b0 2024-04-26T07:30:05.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f560b528700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560409ee50 con 0x7f56041335d0 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f560b528700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f560409f110 con 0x7f560413ea20 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56041335d0 0x7f5604136540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f5609ac5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f560413ea20 0x7f560409db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56041335d0 0x7f5604136540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42440/0 (socket says 172.21.15.31:42440) 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 -- 172.21.15.31:0/82252406 learned_addr learned my addr 172.21.15.31:0/82252406 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f5608ac3700 1 --2- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56041339b0 0x7f5604134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 -- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f560413ea20 msgr2=0x7f560409db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 --2- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f560413ea20 0x7f560409db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 -- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56041339b0 msgr2=0x7f5604134980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 --2- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56041339b0 0x7f5604134980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 -- 172.21.15.31:0/82252406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc009470 con 0x7f56041335d0 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.384+0000 7f56092c4700 1 --2- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56041335d0 0x7f5604136540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f55f4002f70 tx=0x7f55f4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.385+0000 7f55f27fc700 1 -- 172.21.15.31:0/82252406 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55f4016070 con 0x7f56041335d0 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.385+0000 7f55f27fc700 1 -- 172.21.15.31:0/82252406 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f4006780 con 0x7f56041335d0 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.385+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f400b180 con 0x7f56041335d0 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.385+0000 7f55f27fc700 1 -- 172.21.15.31:0/82252406 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55f4013de0 con 0x7f56041335d0 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.385+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5604135f30 con 0x7f56041335d0 2024-04-26T07:30:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.386+0000 7f55f27fc700 1 -- 172.21.15.31:0/82252406 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f55f4025030 con 0x7f56041335d0 2024-04-26T07:30:05.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.386+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5604065ba0 con 0x7f56041335d0 2024-04-26T07:30:05.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.386+0000 7f55f27fc700 1 -- 172.21.15.31:0/82252406 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f55f404b6b0 con 0x7f56041335d0 2024-04-26T07:30:05.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.389+0000 7f55f27fc700 1 -- 172.21.15.31:0/82252406 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f55f4002820 con 0x7f56041335d0 2024-04-26T07:30:05.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.504+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f560406bbc0 con 0x7f55e4038dd0 2024-04-26T07:30:05.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.511+0000 7f55f27fc700 1 -- 172.21.15.31:0/82252406 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252030 (unknown 2965378022 0 2259004093) 0x7f560406bbc0 con 0x7f55e4038dd0 2024-04-26T07:30:05.514 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:30:05.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.513+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 >> v1:172.21.15.31:6816/39613 conn(0x7f55e4038dd0 legacy=0x7f55e403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.513+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56041335d0 msgr2=0x7f5604136540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.513+0000 7f560b528700 1 --2- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56041335d0 0x7f5604136540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f55f4002f70 tx=0x7f55f4014000).stop 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.514+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 shutdown_connections 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.514+0000 7f560b528700 1 --2- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f560413ea20 0x7f560409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.514+0000 7f560b528700 1 --2- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56041335d0 0x7f5604136540 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.514+0000 7f560b528700 1 --2- 172.21.15.31:0/82252406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56041339b0 0x7f5604134980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.514+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 >> 172.21.15.31:0/82252406 conn(0x7f5604060ee0 msgr2=0x7f5604130740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.514+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 shutdown_connections 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.514+0000 7f560b528700 1 -- 172.21.15.31:0/82252406 wait complete. 2024-04-26T07:30:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:30:05.524 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-26T07:30:03.995195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002696"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140126+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:32.140126+0000","last_peered":"2024-04-26T07:28:32.140126+0000","last_clean":"2024-04-26T07:28:32.140126+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:32.140126+0000","last_undegraded":"2024-04-26T07:28:32.140126+0000","last_fullsized":"2024-04-26T07:28:32.140126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140737+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:32.140737+0000","last_peered":"2024-04-26T07:28:32.140737+0000","last_clean":"2024-04-26T07:28:32.140737+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:32.140737+0000","last_undegraded":"2024-04-26T07:28:32.140737+0000","last_fullsized":"2024-04-26T07:28:32.140737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143288+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:32.143288+0000","last_peered":"2024-04-26T07:28:32.143288+0000","last_clean":"2024-04-26T07:28:32.143288+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:32.143288+0000","last_undegraded":"2024-04-26T07:28:32.143288+0000","last_fullsized":"2024-04-26T07:28:32.143288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143164+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:32.143164+0000","last_peered":"2024-04-26T07:28:32.143164+0000","last_clean":"2024-04-26T07:28:32.143164+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:32.143164+0000","last_undegraded":"2024-04-26T07:28:32.143164+0000","last_fullsized":"2024-04-26T07:28:32.143164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142620+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:32.142620+0000","last_peered":"2024-04-26T07:28:32.142620+0000","last_clean":"2024-04-26T07:28:32.142620+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:32.142620+0000","last_undegraded":"2024-04-26T07:28:32.142620+0000","last_fullsized":"2024-04-26T07:28:32.142620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137729+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:32.137729+0000","last_peered":"2024-04-26T07:28:32.137729+0000","last_clean":"2024-04-26T07:28:32.137729+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:32.137729+0000","last_undegraded":"2024-04-26T07:28:32.137729+0000","last_fullsized":"2024-04-26T07:28:32.137729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143368+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:32.143368+0000","last_peered":"2024-04-26T07:28:32.143368+0000","last_clean":"2024-04-26T07:28:32.143368+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:32.143368+0000","last_undegraded":"2024-04-26T07:28:32.143368+0000","last_fullsized":"2024-04-26T07:28:32.143368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138820+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:32.138820+0000","last_peered":"2024-04-26T07:28:32.138820+0000","last_clean":"2024-04-26T07:28:32.138820+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:32.138820+0000","last_undegraded":"2024-04-26T07:28:32.138820+0000","last_fullsized":"2024-04-26T07:28:32.138820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138789+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:32.138789+0000","last_peered":"2024-04-26T07:28:32.138789+0000","last_clean":"2024-04-26T07:28:32.138789+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:32.138789+0000","last_undegraded":"2024-04-26T07:28:32.138789+0000","last_fullsized":"2024-04-26T07:28:32.138789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140217+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:32.140217+0000","last_peered":"2024-04-26T07:28:32.140217+0000","last_clean":"2024-04-26T07:28:32.140217+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:32.140217+0000","last_undegraded":"2024-04-26T07:28:32.140217+0000","last_fullsized":"2024-04-26T07:28:32.140217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140887+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:32.140887+0000","last_peered":"2024-04-26T07:28:32.140887+0000","last_clean":"2024-04-26T07:28:32.140887+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:32.140887+0000","last_undegraded":"2024-04-26T07:28:32.140887+0000","last_fullsized":"2024-04-26T07:28:32.140887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138879+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:32.138879+0000","last_peered":"2024-04-26T07:28:32.138879+0000","last_clean":"2024-04-26T07:28:32.138879+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:32.138879+0000","last_undegraded":"2024-04-26T07:28:32.138879+0000","last_fullsized":"2024-04-26T07:28:32.138879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142710+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:32.142710+0000","last_peered":"2024-04-26T07:28:32.142710+0000","last_clean":"2024-04-26T07:28:32.142710+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:32.142710+0000","last_undegraded":"2024-04-26T07:28:32.142710+0000","last_fullsized":"2024-04-26T07:28:32.142710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143257+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:32.143257+0000","last_peered":"2024-04-26T07:28:32.143257+0000","last_clean":"2024-04-26T07:28:32.143257+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:32.143257+0000","last_undegraded":"2024-04-26T07:28:32.143257+0000","last_fullsized":"2024-04-26T07:28:32.143257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142802+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:32.142802+0000","last_peered":"2024-04-26T07:28:32.142802+0000","last_clean":"2024-04-26T07:28:32.142802+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:32.142802+0000","last_undegraded":"2024-04-26T07:28:32.142802+0000","last_fullsized":"2024-04-26T07:28:32.142802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139998+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:32.139998+0000","last_peered":"2024-04-26T07:28:32.139998+0000","last_clean":"2024-04-26T07:28:32.139998+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:32.139998+0000","last_undegraded":"2024-04-26T07:28:32.139998+0000","last_fullsized":"2024-04-26T07:28:32.139998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139079+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:32.139079+0000","last_peered":"2024-04-26T07:28:32.139079+0000","last_clean":"2024-04-26T07:28:32.139079+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:32.139079+0000","last_undegraded":"2024-04-26T07:28:32.139079+0000","last_fullsized":"2024-04-26T07:28:32.139079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138354+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.138354+0000","last_peered":"2024-04-26T07:28:32.138354+0000","last_clean":"2024-04-26T07:28:32.138354+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:32.138354+0000","last_undegraded":"2024-04-26T07:28:32.138354+0000","last_fullsized":"2024-04-26T07:28:32.138354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142486+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:32.142486+0000","last_peered":"2024-04-26T07:28:32.142486+0000","last_clean":"2024-04-26T07:28:32.142486+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:32.142486+0000","last_undegraded":"2024-04-26T07:28:32.142486+0000","last_fullsized":"2024-04-26T07:28:32.142486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137844+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:32.137844+0000","last_peered":"2024-04-26T07:28:32.137844+0000","last_clean":"2024-04-26T07:28:32.137844+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:32.137844+0000","last_undegraded":"2024-04-26T07:28:32.137844+0000","last_fullsized":"2024-04-26T07:28:32.137844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140794+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.140794+0000","last_peered":"2024-04-26T07:28:32.140794+0000","last_clean":"2024-04-26T07:28:32.140794+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:32.140794+0000","last_undegraded":"2024-04-26T07:28:32.140794+0000","last_fullsized":"2024-04-26T07:28:32.140794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138683+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:32.138683+0000","last_peered":"2024-04-26T07:28:32.138683+0000","last_clean":"2024-04-26T07:28:32.138683+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:32.138683+0000","last_undegraded":"2024-04-26T07:28:32.138683+0000","last_fullsized":"2024-04-26T07:28:32.138683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137704+0000","last_change":"2024-04-26T07:28:30.838970+0000","last_active":"2024-04-26T07:28:32.137704+0000","last_peered":"2024-04-26T07:28:32.137704+0000","last_clean":"2024-04-26T07:28:32.137704+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:28:32.137704+0000","last_undegraded":"2024-04-26T07:28:32.137704+0000","last_fullsized":"2024-04-26T07:28:32.137704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138132+0000","last_change":"2024-04-26T07:28:30.845233+0000","last_active":"2024-04-26T07:28:32.138132+0000","last_peered":"2024-04-26T07:28:32.138132+0000","last_clean":"2024-04-26T07:28:32.138132+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:28:32.138132+0000","last_undegraded":"2024-04-26T07:28:32.138132+0000","last_fullsized":"2024-04-26T07:28:32.138132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142948+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:32.142948+0000","last_peered":"2024-04-26T07:28:32.142948+0000","last_clean":"2024-04-26T07:28:32.142948+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:32.142948+0000","last_undegraded":"2024-04-26T07:28:32.142948+0000","last_fullsized":"2024-04-26T07:28:32.142948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847320+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:33.847320+0000","last_peered":"2024-04-26T07:28:33.847320+0000","last_clean":"2024-04-26T07:28:33.847320+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:33.847320+0000","last_undegraded":"2024-04-26T07:28:33.847320+0000","last_fullsized":"2024-04-26T07:28:33.847320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'7","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:12.136901+0000","last_change":"2024-04-26T07:28:30.850023+0000","last_active":"2024-04-26T07:29:12.136901+0000","last_peered":"2024-04-26T07:29:12.136901+0000","last_clean":"2024-04-26T07:29:12.136901+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:29:12.136901+0000","last_undegraded":"2024-04-26T07:29:12.136901+0000","last_fullsized":"2024-04-26T07:29:12.136901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137664+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:32.137664+0000","last_peered":"2024-04-26T07:28:32.137664+0000","last_clean":"2024-04-26T07:28:32.137664+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:32.137664+0000","last_undegraded":"2024-04-26T07:28:32.137664+0000","last_fullsized":"2024-04-26T07:28:32.137664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848610+0000","last_change":"2024-04-26T07:28:30.853633+0000","last_active":"2024-04-26T07:28:33.848610+0000","last_peered":"2024-04-26T07:28:33.848610+0000","last_clean":"2024-04-26T07:28:33.848610+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:28:33.848610+0000","last_undegraded":"2024-04-26T07:28:33.848610+0000","last_fullsized":"2024-04-26T07:28:33.848610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138363+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:32.138363+0000","last_peered":"2024-04-26T07:28:32.138363+0000","last_clean":"2024-04-26T07:28:32.138363+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:32.138363+0000","last_undegraded":"2024-04-26T07:28:32.138363+0000","last_fullsized":"2024-04-26T07:28:32.138363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848435+0000","last_change":"2024-04-26T07:28:30.849815+0000","last_active":"2024-04-26T07:28:33.848435+0000","last_peered":"2024-04-26T07:28:33.848435+0000","last_clean":"2024-04-26T07:28:33.848435+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:28:33.848435+0000","last_undegraded":"2024-04-26T07:28:33.848435+0000","last_fullsized":"2024-04-26T07:28:33.848435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138036+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:32.138036+0000","last_peered":"2024-04-26T07:28:32.138036+0000","last_clean":"2024-04-26T07:28:32.138036+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:32.138036+0000","last_undegraded":"2024-04-26T07:28:32.138036+0000","last_fullsized":"2024-04-26T07:28:32.138036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'16","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:48.306404+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:29:48.306404+0000","last_peered":"2024-04-26T07:29:48.306404+0000","last_clean":"2024-04-26T07:29:48.306404+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:29:48.306404+0000","last_undegraded":"2024-04-26T07:29:48.306404+0000","last_fullsized":"2024-04-26T07:29:48.306404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140996+0000","last_change":"2024-04-26T07:28:31.165872+0000","last_active":"2024-04-26T07:28:32.140996+0000","last_peered":"2024-04-26T07:28:32.140996+0000","last_clean":"2024-04-26T07:28:32.140996+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:28:32.140996+0000","last_undegraded":"2024-04-26T07:28:32.140996+0000","last_fullsized":"2024-04-26T07:28:32.140996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849427+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:33.849427+0000","last_peered":"2024-04-26T07:28:33.849427+0000","last_clean":"2024-04-26T07:28:33.849427+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:33.849427+0000","last_undegraded":"2024-04-26T07:28:33.849427+0000","last_fullsized":"2024-04-26T07:28:33.849427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137836+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:32.137836+0000","last_peered":"2024-04-26T07:28:32.137836+0000","last_clean":"2024-04-26T07:28:32.137836+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:32.137836+0000","last_undegraded":"2024-04-26T07:28:32.137836+0000","last_fullsized":"2024-04-26T07:28:32.137836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848622+0000","last_change":"2024-04-26T07:28:30.847060+0000","last_active":"2024-04-26T07:28:33.848622+0000","last_peered":"2024-04-26T07:28:33.848622+0000","last_clean":"2024-04-26T07:28:33.848622+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:28:33.848622+0000","last_undegraded":"2024-04-26T07:28:33.848622+0000","last_fullsized":"2024-04-26T07:28:33.848622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139915+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:32.139915+0000","last_peered":"2024-04-26T07:28:32.139915+0000","last_clean":"2024-04-26T07:28:32.139915+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:32.139915+0000","last_undegraded":"2024-04-26T07:28:32.139915+0000","last_fullsized":"2024-04-26T07:28:32.139915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138176+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:32.138176+0000","last_peered":"2024-04-26T07:28:32.138176+0000","last_clean":"2024-04-26T07:28:32.138176+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:32.138176+0000","last_undegraded":"2024-04-26T07:28:32.138176+0000","last_fullsized":"2024-04-26T07:28:32.138176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143072+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:32.143072+0000","last_peered":"2024-04-26T07:28:32.143072+0000","last_clean":"2024-04-26T07:28:32.143072+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:32.143072+0000","last_undegraded":"2024-04-26T07:28:32.143072+0000","last_fullsized":"2024-04-26T07:28:32.143072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847755+0000","last_change":"2024-04-26T07:28:30.839424+0000","last_active":"2024-04-26T07:28:33.847755+0000","last_peered":"2024-04-26T07:28:33.847755+0000","last_clean":"2024-04-26T07:28:33.847755+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:28:33.847755+0000","last_undegraded":"2024-04-26T07:28:33.847755+0000","last_fullsized":"2024-04-26T07:28:33.847755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139763+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:32.139763+0000","last_peered":"2024-04-26T07:28:32.139763+0000","last_clean":"2024-04-26T07:28:32.139763+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:32.139763+0000","last_undegraded":"2024-04-26T07:28:32.139763+0000","last_fullsized":"2024-04-26T07:28:32.139763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142966+0000","last_change":"2024-04-26T07:28:30.849542+0000","last_active":"2024-04-26T07:28:32.142966+0000","last_peered":"2024-04-26T07:28:32.142966+0000","last_clean":"2024-04-26T07:28:32.142966+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:28:32.142966+0000","last_undegraded":"2024-04-26T07:28:32.142966+0000","last_fullsized":"2024-04-26T07:28:32.142966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137801+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:32.137801+0000","last_peered":"2024-04-26T07:28:32.137801+0000","last_clean":"2024-04-26T07:28:32.137801+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:32.137801+0000","last_undegraded":"2024-04-26T07:28:32.137801+0000","last_fullsized":"2024-04-26T07:28:32.137801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140598+0000","last_change":"2024-04-26T07:28:30.853399+0000","last_active":"2024-04-26T07:28:32.140598+0000","last_peered":"2024-04-26T07:28:32.140598+0000","last_clean":"2024-04-26T07:28:32.140598+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:28:32.140598+0000","last_undegraded":"2024-04-26T07:28:32.140598+0000","last_fullsized":"2024-04-26T07:28:32.140598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138273+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:32.138273+0000","last_peered":"2024-04-26T07:28:32.138273+0000","last_clean":"2024-04-26T07:28:32.138273+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:32.138273+0000","last_undegraded":"2024-04-26T07:28:32.138273+0000","last_fullsized":"2024-04-26T07:28:32.138273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140135+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:32.140135+0000","last_peered":"2024-04-26T07:28:32.140135+0000","last_clean":"2024-04-26T07:28:32.140135+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:32.140135+0000","last_undegraded":"2024-04-26T07:28:32.140135+0000","last_fullsized":"2024-04-26T07:28:32.140135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139559+0000","last_change":"2024-04-26T07:28:31.165065+0000","last_active":"2024-04-26T07:28:32.139559+0000","last_peered":"2024-04-26T07:28:32.139559+0000","last_clean":"2024-04-26T07:28:32.139559+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:28:32.139559+0000","last_undegraded":"2024-04-26T07:28:32.139559+0000","last_fullsized":"2024-04-26T07:28:32.139559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143103+0000","last_change":"2024-04-26T07:28:30.844998+0000","last_active":"2024-04-26T07:28:32.143103+0000","last_peered":"2024-04-26T07:28:32.143103+0000","last_clean":"2024-04-26T07:28:32.143103+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:28:32.143103+0000","last_undegraded":"2024-04-26T07:28:32.143103+0000","last_fullsized":"2024-04-26T07:28:32.143103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142942+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:32.142942+0000","last_peered":"2024-04-26T07:28:32.142942+0000","last_clean":"2024-04-26T07:28:32.142942+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:32.142942+0000","last_undegraded":"2024-04-26T07:28:32.142942+0000","last_fullsized":"2024-04-26T07:28:32.142942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849085+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:33.849085+0000","last_peered":"2024-04-26T07:28:33.849085+0000","last_clean":"2024-04-26T07:28:33.849085+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:33.849085+0000","last_undegraded":"2024-04-26T07:28:33.849085+0000","last_fullsized":"2024-04-26T07:28:33.849085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142971+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:32.142971+0000","last_peered":"2024-04-26T07:28:32.142971+0000","last_clean":"2024-04-26T07:28:32.142971+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:32.142971+0000","last_undegraded":"2024-04-26T07:28:32.142971+0000","last_fullsized":"2024-04-26T07:28:32.142971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.136266+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:57.136266+0000","last_peered":"2024-04-26T07:28:57.136266+0000","last_clean":"2024-04-26T07:28:57.136266+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:57.136266+0000","last_undegraded":"2024-04-26T07:28:57.136266+0000","last_fullsized":"2024-04-26T07:28:57.136266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140027+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:32.140027+0000","last_peered":"2024-04-26T07:28:32.140027+0000","last_clean":"2024-04-26T07:28:32.140027+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:32.140027+0000","last_undegraded":"2024-04-26T07:28:32.140027+0000","last_fullsized":"2024-04-26T07:28:32.140027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848748+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:33.848748+0000","last_peered":"2024-04-26T07:28:33.848748+0000","last_clean":"2024-04-26T07:28:33.848748+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:33.848748+0000","last_undegraded":"2024-04-26T07:28:33.848748+0000","last_fullsized":"2024-04-26T07:28:33.848748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140673+0000","last_change":"2024-04-26T07:28:31.164112+0000","last_active":"2024-04-26T07:28:32.140673+0000","last_peered":"2024-04-26T07:28:32.140673+0000","last_clean":"2024-04-26T07:28:32.140673+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:28:32.140673+0000","last_undegraded":"2024-04-26T07:28:32.140673+0000","last_fullsized":"2024-04-26T07:28:32.140673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849508+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:33.849508+0000","last_peered":"2024-04-26T07:28:33.849508+0000","last_clean":"2024-04-26T07:28:33.849508+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:33.849508+0000","last_undegraded":"2024-04-26T07:28:33.849508+0000","last_fullsized":"2024-04-26T07:28:33.849508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140916+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:32.140916+0000","last_peered":"2024-04-26T07:28:32.140916+0000","last_clean":"2024-04-26T07:28:32.140916+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:32.140916+0000","last_undegraded":"2024-04-26T07:28:32.140916+0000","last_fullsized":"2024-04-26T07:28:32.140916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138969+0000","last_change":"2024-04-26T07:28:22.650334+0000","last_active":"2024-04-26T07:28:32.138969+0000","last_peered":"2024-04-26T07:28:32.138969+0000","last_clean":"2024-04-26T07:28:32.138969+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:28:32.138969+0000","last_undegraded":"2024-04-26T07:28:32.138969+0000","last_fullsized":"2024-04-26T07:28:32.138969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848587+0000","last_change":"2024-04-26T07:28:30.851175+0000","last_active":"2024-04-26T07:28:33.848587+0000","last_peered":"2024-04-26T07:28:33.848587+0000","last_clean":"2024-04-26T07:28:33.848587+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:28:33.848587+0000","last_undegraded":"2024-04-26T07:28:33.848587+0000","last_fullsized":"2024-04-26T07:28:33.848587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137905+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.137905+0000","last_peered":"2024-04-26T07:28:32.137905+0000","last_clean":"2024-04-26T07:28:32.137905+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:32.137905+0000","last_undegraded":"2024-04-26T07:28:32.137905+0000","last_fullsized":"2024-04-26T07:28:32.137905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139162+0000","last_change":"2024-04-26T07:28:22.023450+0000","last_active":"2024-04-26T07:28:32.139162+0000","last_peered":"2024-04-26T07:28:32.139162+0000","last_clean":"2024-04-26T07:28:32.139162+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:28:32.139162+0000","last_undegraded":"2024-04-26T07:28:32.139162+0000","last_fullsized":"2024-04-26T07:28:32.139162+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:46.777814+0000","last_change":"2024-04-26T07:28:30.853616+0000","last_active":"2024-04-26T07:28:46.777814+0000","last_peered":"2024-04-26T07:28:46.777814+0000","last_clean":"2024-04-26T07:28:46.777814+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:28:46.777814+0000","last_undegraded":"2024-04-26T07:28:46.777814+0000","last_fullsized":"2024-04-26T07:28:46.777814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139154+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:32.139154+0000","last_peered":"2024-04-26T07:28:32.139154+0000","last_clean":"2024-04-26T07:28:32.139154+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:32.139154+0000","last_undegraded":"2024-04-26T07:28:32.139154+0000","last_fullsized":"2024-04-26T07:28:32.139154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139749+0000","last_change":"2024-04-26T07:28:22.024031+0000","last_active":"2024-04-26T07:28:32.139749+0000","last_peered":"2024-04-26T07:28:32.139749+0000","last_clean":"2024-04-26T07:28:32.139749+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:28:32.139749+0000","last_undegraded":"2024-04-26T07:28:32.139749+0000","last_fullsized":"2024-04-26T07:28:32.139749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.846746+0000","last_change":"2024-04-26T07:28:30.839738+0000","last_active":"2024-04-26T07:28:33.846746+0000","last_peered":"2024-04-26T07:28:33.846746+0000","last_clean":"2024-04-26T07:28:33.846746+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:28:33.846746+0000","last_undegraded":"2024-04-26T07:28:33.846746+0000","last_fullsized":"2024-04-26T07:28:33.846746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140827+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:32.140827+0000","last_peered":"2024-04-26T07:28:32.140827+0000","last_clean":"2024-04-26T07:28:32.140827+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:32.140827+0000","last_undegraded":"2024-04-26T07:28:32.140827+0000","last_fullsized":"2024-04-26T07:28:32.140827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137628+0000","last_change":"2024-04-26T07:28:22.023795+0000","last_active":"2024-04-26T07:28:32.137628+0000","last_peered":"2024-04-26T07:28:32.137628+0000","last_clean":"2024-04-26T07:28:32.137628+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:28:32.137628+0000","last_undegraded":"2024-04-26T07:28:32.137628+0000","last_fullsized":"2024-04-26T07:28:32.137628+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137893+0000","last_change":"2024-04-26T07:28:18.549478+0000","last_active":"2024-04-26T07:28:32.137893+0000","last_peered":"2024-04-26T07:28:32.137893+0000","last_clean":"2024-04-26T07:28:32.137893+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:28:32.137893+0000","last_undegraded":"2024-04-26T07:28:32.137893+0000","last_fullsized":"2024-04-26T07:28:32.137893+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_clean_scrub_stamp":"2024-04-26T07:28:14.971410+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138992+0000","last_change":"2024-04-26T07:28:30.859261+0000","last_active":"2024-04-26T07:28:32.138992+0000","last_peered":"2024-04-26T07:28:32.138992+0000","last_clean":"2024-04-26T07:28:32.138992+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:28:32.138992+0000","last_undegraded":"2024-04-26T07:28:32.138992+0000","last_fullsized":"2024-04-26T07:28:32.138992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140556+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:32.140556+0000","last_peered":"2024-04-26T07:28:32.140556+0000","last_clean":"2024-04-26T07:28:32.140556+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:32.140556+0000","last_undegraded":"2024-04-26T07:28:32.140556+0000","last_fullsized":"2024-04-26T07:28:32.140556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137311+0000","last_change":"2024-04-26T07:28:22.026306+0000","last_active":"2024-04-26T07:28:32.137311+0000","last_peered":"2024-04-26T07:28:32.137311+0000","last_clean":"2024-04-26T07:28:32.137311+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:28:32.137311+0000","last_undegraded":"2024-04-26T07:28:32.137311+0000","last_fullsized":"2024-04-26T07:28:32.137311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847145+0000","last_change":"2024-04-26T07:28:30.854930+0000","last_active":"2024-04-26T07:28:33.847145+0000","last_peered":"2024-04-26T07:28:33.847145+0000","last_clean":"2024-04-26T07:28:33.847145+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:28:33.847145+0000","last_undegraded":"2024-04-26T07:28:33.847145+0000","last_fullsized":"2024-04-26T07:28:33.847145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143152+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:32.143152+0000","last_peered":"2024-04-26T07:28:32.143152+0000","last_clean":"2024-04-26T07:28:32.143152+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:32.143152+0000","last_undegraded":"2024-04-26T07:28:32.143152+0000","last_fullsized":"2024-04-26T07:28:32.143152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140322+0000","last_change":"2024-04-26T07:28:22.650352+0000","last_active":"2024-04-26T07:28:32.140322+0000","last_peered":"2024-04-26T07:28:32.140322+0000","last_clean":"2024-04-26T07:28:32.140322+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:28:32.140322+0000","last_undegraded":"2024-04-26T07:28:32.140322+0000","last_fullsized":"2024-04-26T07:28:32.140322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138450+0000","last_change":"2024-04-26T07:28:30.844050+0000","last_active":"2024-04-26T07:28:32.138450+0000","last_peered":"2024-04-26T07:28:32.138450+0000","last_clean":"2024-04-26T07:28:32.138450+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:28:32.138450+0000","last_undegraded":"2024-04-26T07:28:32.138450+0000","last_fullsized":"2024-04-26T07:28:32.138450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142850+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:32.142850+0000","last_peered":"2024-04-26T07:28:32.142850+0000","last_clean":"2024-04-26T07:28:32.142850+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:32.142850+0000","last_undegraded":"2024-04-26T07:28:32.142850+0000","last_fullsized":"2024-04-26T07:28:32.142850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848248+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:33.848248+0000","last_peered":"2024-04-26T07:28:33.848248+0000","last_clean":"2024-04-26T07:28:33.848248+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:33.848248+0000","last_undegraded":"2024-04-26T07:28:33.848248+0000","last_fullsized":"2024-04-26T07:28:33.848248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138741+0000","last_change":"2024-04-26T07:28:22.650310+0000","last_active":"2024-04-26T07:28:32.138741+0000","last_peered":"2024-04-26T07:28:32.138741+0000","last_clean":"2024-04-26T07:28:32.138741+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:28:32.138741+0000","last_undegraded":"2024-04-26T07:28:32.138741+0000","last_fullsized":"2024-04-26T07:28:32.138741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137320+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:32.137320+0000","last_peered":"2024-04-26T07:28:32.137320+0000","last_clean":"2024-04-26T07:28:32.137320+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:32.137320+0000","last_undegraded":"2024-04-26T07:28:32.137320+0000","last_fullsized":"2024-04-26T07:28:32.137320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139639+0000","last_change":"2024-04-26T07:28:22.650378+0000","last_active":"2024-04-26T07:28:32.139639+0000","last_peered":"2024-04-26T07:28:32.139639+0000","last_clean":"2024-04-26T07:28:32.139639+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:28:32.139639+0000","last_undegraded":"2024-04-26T07:28:32.139639+0000","last_fullsized":"2024-04-26T07:28:32.139639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:52.140606+0000","last_change":"2024-04-26T07:28:30.848849+0000","last_active":"2024-04-26T07:28:52.140606+0000","last_peered":"2024-04-26T07:28:52.140606+0000","last_clean":"2024-04-26T07:28:52.140606+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:28:52.140606+0000","last_undegraded":"2024-04-26T07:28:52.140606+0000","last_fullsized":"2024-04-26T07:28:52.140606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139591+0000","last_change":"2024-04-26T07:28:31.160967+0000","last_active":"2024-04-26T07:28:32.139591+0000","last_peered":"2024-04-26T07:28:32.139591+0000","last_clean":"2024-04-26T07:28:32.139591+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:28:32.139591+0000","last_undegraded":"2024-04-26T07:28:32.139591+0000","last_fullsized":"2024-04-26T07:28:32.139591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'10","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.139239+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:57.139239+0000","last_peered":"2024-04-26T07:28:57.139239+0000","last_clean":"2024-04-26T07:28:57.139239+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:57.139239+0000","last_undegraded":"2024-04-26T07:28:57.139239+0000","last_fullsized":"2024-04-26T07:28:57.139239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140278+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:32.140278+0000","last_peered":"2024-04-26T07:28:32.140278+0000","last_clean":"2024-04-26T07:28:32.140278+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:32.140278+0000","last_undegraded":"2024-04-26T07:28:32.140278+0000","last_fullsized":"2024-04-26T07:28:32.140278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138737+0000","last_change":"2024-04-26T07:28:30.852699+0000","last_active":"2024-04-26T07:28:32.138737+0000","last_peered":"2024-04-26T07:28:32.138737+0000","last_clean":"2024-04-26T07:28:32.138737+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:28:32.138737+0000","last_undegraded":"2024-04-26T07:28:32.138737+0000","last_fullsized":"2024-04-26T07:28:32.138737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140941+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:32.140941+0000","last_peered":"2024-04-26T07:28:32.140941+0000","last_clean":"2024-04-26T07:28:32.140941+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:32.140941+0000","last_undegraded":"2024-04-26T07:28:32.140941+0000","last_fullsized":"2024-04-26T07:28:32.140941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140429+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:32.140429+0000","last_peered":"2024-04-26T07:28:32.140429+0000","last_clean":"2024-04-26T07:28:32.140429+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:32.140429+0000","last_undegraded":"2024-04-26T07:28:32.140429+0000","last_fullsized":"2024-04-26T07:28:32.140429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139495+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:32.139495+0000","last_peered":"2024-04-26T07:28:32.139495+0000","last_clean":"2024-04-26T07:28:32.139495+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:32.139495+0000","last_undegraded":"2024-04-26T07:28:32.139495+0000","last_fullsized":"2024-04-26T07:28:32.139495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138254+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:32.138254+0000","last_peered":"2024-04-26T07:28:32.138254+0000","last_clean":"2024-04-26T07:28:32.138254+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:32.138254+0000","last_undegraded":"2024-04-26T07:28:32.138254+0000","last_fullsized":"2024-04-26T07:28:32.138254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143222+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:32.143222+0000","last_peered":"2024-04-26T07:28:32.143222+0000","last_clean":"2024-04-26T07:28:32.143222+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:32.143222+0000","last_undegraded":"2024-04-26T07:28:32.143222+0000","last_fullsized":"2024-04-26T07:28:32.143222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139300+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:32.139300+0000","last_peered":"2024-04-26T07:28:32.139300+0000","last_clean":"2024-04-26T07:28:32.139300+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:32.139300+0000","last_undegraded":"2024-04-26T07:28:32.139300+0000","last_fullsized":"2024-04-26T07:28:32.139300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138401+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:32.138401+0000","last_peered":"2024-04-26T07:28:32.138401+0000","last_clean":"2024-04-26T07:28:32.138401+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:32.138401+0000","last_undegraded":"2024-04-26T07:28:32.138401+0000","last_fullsized":"2024-04-26T07:28:32.138401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143246+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:32.143246+0000","last_peered":"2024-04-26T07:28:32.143246+0000","last_clean":"2024-04-26T07:28:32.143246+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:32.143246+0000","last_undegraded":"2024-04-26T07:28:32.143246+0000","last_fullsized":"2024-04-26T07:28:32.143246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138871+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:32.138871+0000","last_peered":"2024-04-26T07:28:32.138871+0000","last_clean":"2024-04-26T07:28:32.138871+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:32.138871+0000","last_undegraded":"2024-04-26T07:28:32.138871+0000","last_fullsized":"2024-04-26T07:28:32.138871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705687,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.46899999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705688,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.371},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.34799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.21199999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.247},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"last":0.224},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.23599999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705687,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29699999999999999}]}]}]}} 2024-04-26T07:30:05.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:30:05.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.670+0000 7f8a27a1e700 1 Processor -- start 2024-04-26T07:30:05.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a27a1e700 1 -- start start 2024-04-26T07:30:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a27a1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a20134460 0x7f8a20065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a27a1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a200635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a27a1e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a20065770 con 0x7f8a20063aa0 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a27a1e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2009c5e0 con 0x7f8a20134460 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a27a1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20134240 con 0x7f8a20134840 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a24fb9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a200635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a25fbb700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8a20063aa0 0x7f8a2009a8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60170/0 (socket says 172.21.15.31:60170) 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a25fbb700 1 -- 172.21.15.31:0/1718718456 learned_addr learned my addr 172.21.15.31:0/1718718456 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.671+0000 7f8a257ba700 1 --2- 172.21.15.31:0/1718718456 >> v2:172.21.15.31:3300/0 conn(0x7f8a20134460 0x7f8a20065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a24fb9700 1 -- 172.21.15.31:0/1718718456 >> v2:172.21.15.31:3300/0 conn(0x7f8a20134460 msgr2=0x7f8a20065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a24fb9700 1 --2- 172.21.15.31:0/1718718456 >> v2:172.21.15.31:3300/0 conn(0x7f8a20134460 0x7f8a20065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a24fb9700 1 -- 172.21.15.31:0/1718718456 >> v1:172.21.15.31:6789/0 conn(0x7f8a20063aa0 legacy=0x7f8a2009a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a24fb9700 1 -- 172.21.15.31:0/1718718456 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2009bb10 con 0x7f8a20134840 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a257ba700 1 --2- 172.21.15.31:0/1718718456 >> v2:172.21.15.31:3300/0 conn(0x7f8a20134460 0x7f8a20065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a24fb9700 1 --2- 172.21.15.31:0/1718718456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a200635b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f8a1c002f70 tx=0x7f8a1c006df0).ready entity=mon.1 client_cookie=417c5c8e9150f676 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a13fff700 1 -- 172.21.15.31:0/1718718456 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1c00d570 con 0x7f8a20134840 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a13fff700 1 -- 172.21.15.31:0/1718718456 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c000e90 con 0x7f8a20134840 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a13fff700 1 -- 172.21.15.31:0/1718718456 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1c00d8c0 con 0x7f8a20134840 2024-04-26T07:30:05.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a27a1e700 1 -- 172.21.15.31:0/1718718456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 msgr2=0x7f8a200635b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a27a1e700 1 --2- 172.21.15.31:0/1718718456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a200635b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f8a1c002f70 tx=0x7f8a1c006df0).stop 2024-04-26T07:30:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a27a1e700 1 -- 172.21.15.31:0/1718718456 shutdown_connections 2024-04-26T07:30:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a27a1e700 1 --2- 172.21.15.31:0/1718718456 >> v2:172.21.15.31:3300/0 conn(0x7f8a20134460 0x7f8a20065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a27a1e700 1 --2- 172.21.15.31:0/1718718456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a200635b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.672+0000 7f8a27a1e700 1 -- 172.21.15.31:0/1718718456 >> 172.21.15.31:0/1718718456 conn(0x7f8a2005cfb0 msgr2=0x7f8a20062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.673+0000 7f8a27a1e700 1 -- 172.21.15.31:0/1718718456 shutdown_connections 2024-04-26T07:30:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.673+0000 7f8a27a1e700 1 -- 172.21.15.31:0/1718718456 wait complete. 2024-04-26T07:30:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.673+0000 7f8a27a1e700 1 Processor -- start 2024-04-26T07:30:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.673+0000 7f8a27a1e700 1 -- start start 2024-04-26T07:30:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a27a1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a20063aa0 0x7f8a20099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a27a1e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a20134460 0x7f8a20097920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a27a1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a2012fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a27a1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200611f0 con 0x7f8a20063aa0 2024-04-26T07:30:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a27a1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20061420 con 0x7f8a20134840 2024-04-26T07:30:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a27a1e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200616e0 con 0x7f8a20134460 2024-04-26T07:30:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a257ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a20063aa0 0x7f8a20099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a25fbb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a2012fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a257ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a20063aa0 0x7f8a20099850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38250/0 (socket says 172.21.15.31:38250) 2024-04-26T07:30:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a257ba700 1 -- 172.21.15.31:0/3934167084 learned_addr learned my addr 172.21.15.31:0/3934167084 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a24fb9700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a20134460 0x7f8a20097920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a25fbb700 1 -- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a20134460 msgr2=0x7f8a20097920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a25fbb700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a20134460 0x7f8a20097920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a25fbb700 1 -- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a20063aa0 msgr2=0x7f8a20099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a25fbb700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a20063aa0 0x7f8a20099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a25fbb700 1 -- 172.21.15.31:0/3934167084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1400b180 con 0x7f8a20134840 2024-04-26T07:30:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.674+0000 7f8a257ba700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a20063aa0 0x7f8a20099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.675+0000 7f8a25fbb700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a2012fee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8a200ab0c0 tx=0x7f8a18007e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.675+0000 7f8a127fc700 1 -- 172.21.15.31:0/3934167084 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a18005ba0 con 0x7f8a20134840 2024-04-26T07:30:05.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.675+0000 7f8a127fc700 1 -- 172.21.15.31:0/3934167084 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a18005d00 con 0x7f8a20134840 2024-04-26T07:30:05.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.675+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c00b180 con 0x7f8a20134840 2024-04-26T07:30:05.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.675+0000 7f8a127fc700 1 -- 172.21.15.31:0/3934167084 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a180072c0 con 0x7f8a20134840 2024-04-26T07:30:05.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.675+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a20097e90 con 0x7f8a20134840 2024-04-26T07:30:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.676+0000 7f8a127fc700 1 -- 172.21.15.31:0/3934167084 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8a1801a060 con 0x7f8a20134840 2024-04-26T07:30:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.676+0000 7f8a127fc700 1 -- 172.21.15.31:0/3934167084 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8a1804a030 con 0x7f8a20134840 2024-04-26T07:30:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.676+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a20065770 con 0x7f8a20134840 2024-04-26T07:30:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.679+0000 7f8a127fc700 1 -- 172.21.15.31:0/3934167084 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8a20065770 con 0x7f8a20134840 2024-04-26T07:30:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.798+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a20097620 con 0x7f8a20134840 2024-04-26T07:30:05.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.799+0000 7f8a127fc700 1 -- 172.21.15.31:0/3934167084 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7f8a18018070 con 0x7f8a20134840 2024-04-26T07:30:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:30:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:45.886508+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:30:05.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 >> v1:172.21.15.31:6816/39613 conn(0x7f8a00038e30 legacy=0x7f8a0003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 msgr2=0x7f8a2012fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a2012fee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8a200ab0c0 tx=0x7f8a18007e90).stop 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 shutdown_connections 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a20134840 0x7f8a2012fee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a20063aa0 0x7f8a20099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 --2- 172.21.15.31:0/3934167084 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a20134460 0x7f8a20097920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 >> 172.21.15.31:0/3934167084 conn(0x7f8a2005cfb0 msgr2=0x7f8a2006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 shutdown_connections 2024-04-26T07:30:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:05.800+0000 7f8a27a1e700 1 -- 172.21.15.31:0/3934167084 wait complete. 2024-04-26T07:30:06.812 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T07:30:06.812 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:30:06.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.934+0000 7f40ca5fa700 1 Processor -- start 2024-04-26T07:30:06.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.934+0000 7f40ca5fa700 1 -- start start 2024-04-26T07:30:06.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40ca5fa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40c41356f0 0x7f40c40a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:06.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40ca5fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c40a39e0 0x7f40c413e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:06.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40ca5fa700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c40a1980 con 0x7f40c4135ad0 2024-04-26T07:30:06.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40ca5fa700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c40a1bb0 con 0x7f40c41356f0 2024-04-26T07:30:06.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40ca5fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c409fdf0 con 0x7f40c40a39e0 2024-04-26T07:30:06.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c8b97700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c40a39e0 0x7f40c413e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:06.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40c41356f0 0x7f40c40a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:06.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f40c4135ad0 0x7f40c40a32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60186/0 (socket says 172.21.15.31:60186) 2024-04-26T07:30:06.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c8b97700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c40a39e0 0x7f40c413e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42454/0 (socket says 172.21.15.31:42454) 2024-04-26T07:30:06.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40c41356f0 0x7f40c40a0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38258/0 (socket says 172.21.15.31:38258) 2024-04-26T07:30:06.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c37fe700 1 -- 172.21.15.31:0/3104558263 learned_addr learned my addr 172.21.15.31:0/3104558263 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:06.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c8b97700 1 -- 172.21.15.31:0/3104558263 >> v2:172.21.15.31:3300/0 conn(0x7f40c41356f0 msgr2=0x7f40c40a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:06.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c8b97700 1 --2- 172.21.15.31:0/3104558263 >> v2:172.21.15.31:3300/0 conn(0x7f40c41356f0 0x7f40c40a0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:06.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c8b97700 1 -- 172.21.15.31:0/3104558263 >> v1:172.21.15.31:6789/0 conn(0x7f40c4135ad0 legacy=0x7f40c40a32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:06.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c2ffd700 1 -- 172.21.15.31:0/3104558263 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450643424 0 0) 0x7f40c40a1980 con 0x7f40c4135ad0 2024-04-26T07:30:06.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c8b97700 1 -- 172.21.15.31:0/3104558263 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c40a24f0 con 0x7f40c40a39e0 2024-04-26T07:30:06.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c3fff700 1 --2- 172.21.15.31:0/3104558263 >> v2:172.21.15.31:3300/0 conn(0x7f40c41356f0 0x7f40c40a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:06.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.935+0000 7f40c8b97700 1 --2- 172.21.15.31:0/3104558263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c40a39e0 0x7f40c413e510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f40bc0032f0 tx=0x7f40bc0091d0).ready entity=mon.1 client_cookie=a41e8a7d91b4f650 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:06.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40c2ffd700 1 -- 172.21.15.31:0/3104558263 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40bc00b6c0 con 0x7f40c40a39e0 2024-04-26T07:30:06.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40c2ffd700 1 -- 172.21.15.31:0/3104558263 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc00b820 con 0x7f40c40a39e0 2024-04-26T07:30:06.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40c2ffd700 1 -- 172.21.15.31:0/3104558263 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40bc00b990 con 0x7f40c40a39e0 2024-04-26T07:30:06.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40ca5fa700 1 -- 172.21.15.31:0/3104558263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c40a39e0 msgr2=0x7f40c413e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:06.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40ca5fa700 1 --2- 172.21.15.31:0/3104558263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c40a39e0 0x7f40c413e510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f40bc0032f0 tx=0x7f40bc0091d0).stop 2024-04-26T07:30:06.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40ca5fa700 1 -- 172.21.15.31:0/3104558263 shutdown_connections 2024-04-26T07:30:06.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40ca5fa700 1 --2- 172.21.15.31:0/3104558263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c40a39e0 0x7f40c413e510 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:06.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40ca5fa700 1 --2- 172.21.15.31:0/3104558263 >> v2:172.21.15.31:3300/0 conn(0x7f40c41356f0 0x7f40c40a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:06.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40ca5fa700 1 -- 172.21.15.31:0/3104558263 >> 172.21.15.31:0/3104558263 conn(0x7f40c40a53d0 msgr2=0x7f40c40a57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:06.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40ca5fa700 1 -- 172.21.15.31:0/3104558263 shutdown_connections 2024-04-26T07:30:06.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.936+0000 7f40ca5fa700 1 -- 172.21.15.31:0/3104558263 wait complete. 2024-04-26T07:30:06.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.937+0000 7f40ca5fa700 1 Processor -- start 2024-04-26T07:30:06.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.937+0000 7f40ca5fa700 1 -- start start 2024-04-26T07:30:06.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40ca5fa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c40a39e0 0x7f40c4093e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:06.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40ca5fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c41356f0 0x7f40c4143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:06.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40ca5fa700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40c4135ad0 0x7f40c4143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:06.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40ca5fa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4094960 con 0x7f40c40a39e0 2024-04-26T07:30:06.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40ca5fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c405b970 con 0x7f40c41356f0 2024-04-26T07:30:06.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40ca5fa700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4093630 con 0x7f40c4135ad0 2024-04-26T07:30:06.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c41356f0 0x7f40c4143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:06.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c40a39e0 0x7f40c4093e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c41356f0 0x7f40c4143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42464/0 (socket says 172.21.15.31:42464) 2024-04-26T07:30:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 -- 172.21.15.31:0/1795211111 learned_addr learned my addr 172.21.15.31:0/1795211111 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c8b97700 1 --2- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40c4135ad0 0x7f40c4143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 -- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40c4135ad0 msgr2=0x7f40c4143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 --2- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40c4135ad0 0x7f40c4143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 -- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c40a39e0 msgr2=0x7f40c4093e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 --2- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c40a39e0 0x7f40c4093e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:06.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 -- 172.21.15.31:0/1795211111 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b400b180 con 0x7f40c41356f0 2024-04-26T07:30:06.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c3fff700 1 --2- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40c40a39e0 0x7f40c4093e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:06.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.938+0000 7f40c37fe700 1 --2- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c41356f0 0x7f40c4143620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f40ac000bc0 tx=0x7f40ac007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:06.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.939+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac00ce00 con 0x7f40c41356f0 2024-04-26T07:30:06.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.939+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac0070d0 con 0x7f40c41356f0 2024-04-26T07:30:06.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.939+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc009470 con 0x7f40c41356f0 2024-04-26T07:30:06.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.939+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac007430 con 0x7f40c41356f0 2024-04-26T07:30:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.939+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c40943e0 con 0x7f40c41356f0 2024-04-26T07:30:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.939+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40c405bab0 con 0x7f40c41356f0 2024-04-26T07:30:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.940+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f40ac010070 con 0x7f40c41356f0 2024-04-26T07:30:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.940+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f40ac049ea0 con 0x7f40c41356f0 2024-04-26T07:30:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.940+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 --> v1:172.21.15.31:6800/40242 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40a8045600 con 0x7f40a8041910 2024-04-26T07:30:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.940+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40ac04f4a0 con 0x7f40c41356f0 2024-04-26T07:30:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.941+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 <== osd.0 v1:172.21.15.31:6800/40242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f40a8045600 con 0x7f40a8041910 2024-04-26T07:30:06.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.955+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 --> v1:172.21.15.31:6800/40242 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40c40a2790 con 0x7f40a8041910 2024-04-26T07:30:06.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.955+0000 7f40c17fa700 1 -- 172.21.15.31:0/1795211111 <== osd.0 v1:172.21.15.31:6800/40242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f40c40a2790 con 0x7f40a8041910 2024-04-26T07:30:06.964 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-26T07:30:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-04-26T07:30:06.965 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-26T07:30:06.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 >> v1:172.21.15.31:6800/40242 conn(0x7f40a8041910 legacy=0x7f40a8043d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:06.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 >> v1:172.21.15.31:6816/39613 conn(0x7f40a8038da0 legacy=0x7f40a803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:06.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c41356f0 msgr2=0x7f40c4143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:06.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40ca5fa700 1 --2- 172.21.15.31:0/1795211111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40c41356f0 0x7f40c4143620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f40ac000bc0 tx=0x7f40ac007c90).stop 2024-04-26T07:30:06.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40c8b97700 1 -- 172.21.15.31:0/1795211111 reap_dead start 2024-04-26T07:30:06.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 shutdown_connections 2024-04-26T07:30:06.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 >> 172.21.15.31:0/1795211111 conn(0x7f40c40a53d0 msgr2=0x7f40c40a8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:06.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 shutdown_connections 2024-04-26T07:30:06.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:06.956+0000 7f40ca5fa700 1 -- 172.21.15.31:0/1795211111 wait complete. 2024-04-26T07:30:06.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T07:30:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.078+0000 7f4fa3573700 1 Processor -- start 2024-04-26T07:30:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.078+0000 7f4fa3573700 1 -- start start 2024-04-26T07:30:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa3573700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1335d0 0x7f4f9c0679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa3573700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f9c1339b0 0x7f4f9c0a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa3573700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c067ec0 con 0x7f4f9c05b970 2024-04-26T07:30:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa3573700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c0670c0 con 0x7f4f9c1339b0 2024-04-26T07:30:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa3573700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c066600 con 0x7f4f9c1335d0 2024-04-26T07:30:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa0b0e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f9c1339b0 0x7f4f9c0a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa130f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1335d0 0x7f4f9c0679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa1b10700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4f9c05b970 0x7f4f9c05be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60188/0 (socket says 172.21.15.31:60188) 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa1b10700 1 -- 172.21.15.31:0/792983926 learned_addr learned my addr 172.21.15.31:0/792983926 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa0b0e700 1 -- 172.21.15.31:0/792983926 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1335d0 msgr2=0x7f4f9c0679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa0b0e700 1 --2- 172.21.15.31:0/792983926 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1335d0 0x7f4f9c0679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa0b0e700 1 -- 172.21.15.31:0/792983926 >> v1:172.21.15.31:6789/0 conn(0x7f4f9c05b970 legacy=0x7f4f9c05be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4f8bfff700 1 -- 172.21.15.31:0/792983926 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169275130 0 0) 0x7f4f9c067ec0 con 0x7f4f9c05b970 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa0b0e700 1 -- 172.21.15.31:0/792983926 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c066de0 con 0x7f4f9c1339b0 2024-04-26T07:30:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa130f700 1 --2- 172.21.15.31:0/792983926 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1335d0 0x7f4f9c0679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4fa0b0e700 1 --2- 172.21.15.31:0/792983926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1339b0 0x7f4f9c0a43e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4f98002f70 tx=0x7f4f98006df0).ready entity=mon.0 client_cookie=d124ff8663771766 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.079+0000 7f4f8bfff700 1 -- 172.21.15.31:0/792983926 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f9800d570 con 0x7f4f9c1339b0 2024-04-26T07:30:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4f8bfff700 1 -- 172.21.15.31:0/792983926 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f98000e90 con 0x7f4f9c1339b0 2024-04-26T07:30:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4f8bfff700 1 -- 172.21.15.31:0/792983926 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f9800d8c0 con 0x7f4f9c1339b0 2024-04-26T07:30:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4fa3573700 1 -- 172.21.15.31:0/792983926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1339b0 msgr2=0x7f4f9c0a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4fa3573700 1 --2- 172.21.15.31:0/792983926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1339b0 0x7f4f9c0a43e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4f98002f70 tx=0x7f4f98006df0).stop 2024-04-26T07:30:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4fa3573700 1 -- 172.21.15.31:0/792983926 shutdown_connections 2024-04-26T07:30:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4fa3573700 1 --2- 172.21.15.31:0/792983926 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1335d0 0x7f4f9c0679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4fa3573700 1 --2- 172.21.15.31:0/792983926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1339b0 0x7f4f9c0a43e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4fa3573700 1 -- 172.21.15.31:0/792983926 >> 172.21.15.31:0/792983926 conn(0x7f4f9c060ee0 msgr2=0x7f4f9c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4fa3573700 1 -- 172.21.15.31:0/792983926 shutdown_connections 2024-04-26T07:30:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.080+0000 7f4fa3573700 1 -- 172.21.15.31:0/792983926 wait complete. 2024-04-26T07:30:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.081+0000 7f4fa3573700 1 Processor -- start 2024-04-26T07:30:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.081+0000 7f4fa3573700 1 -- start start 2024-04-26T07:30:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa3573700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f9c05b970 0x7f4f9c149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa3573700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1335d0 0x7f4f9c130440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa3573700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1339b0 0x7f4f9c130930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa3573700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1357d0 con 0x7f4f9c1335d0 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa3573700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1366e0 con 0x7f4f9c05b970 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa3573700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c149920 con 0x7f4f9c1339b0 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f9c05b970 0x7f4f9c149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa0b0e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1335d0 0x7f4f9c130440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f9c05b970 0x7f4f9c149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42476/0 (socket says 172.21.15.31:42476) 2024-04-26T07:30:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 -- 172.21.15.31:0/2362799999 learned_addr learned my addr 172.21.15.31:0/2362799999 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa1b10700 1 --2- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1339b0 0x7f4f9c130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 -- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1339b0 msgr2=0x7f4f9c130930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 --2- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1339b0 0x7f4f9c130930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 -- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1335d0 msgr2=0x7f4f9c130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 --2- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1335d0 0x7f4f9c130440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 -- 172.21.15.31:0/2362799999 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c00b180 con 0x7f4f9c05b970 2024-04-26T07:30:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa130f700 1 --2- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f9c05b970 0x7f4f9c149180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4f8c00c000 tx=0x7f4f8c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4f8a7fc700 1 -- 172.21.15.31:0/2362799999 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f8c00c7e0 con 0x7f4f9c05b970 2024-04-26T07:30:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4f8a7fc700 1 -- 172.21.15.31:0/2362799999 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00c940 con 0x7f4f9c05b970 2024-04-26T07:30:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9800b180 con 0x7f4f9c05b970 2024-04-26T07:30:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.082+0000 7f4f8a7fc700 1 -- 172.21.15.31:0/2362799999 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f8c00cca0 con 0x7f4f9c05b970 2024-04-26T07:30:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.083+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c149670 con 0x7f4f9c05b970 2024-04-26T07:30:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.083+0000 7f4f8a7fc700 1 -- 172.21.15.31:0/2362799999 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4f8c01c460 con 0x7f4f9c05b970 2024-04-26T07:30:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.083+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c065ba0 con 0x7f4f9c05b970 2024-04-26T07:30:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.083+0000 7f4f8a7fc700 1 -- 172.21.15.31:0/2362799999 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4f8c04adf0 con 0x7f4f9c05b970 2024-04-26T07:30:07.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.087+0000 7f4f8a7fc700 1 -- 172.21.15.31:0/2362799999 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4f8c033720 con 0x7f4f9c05b970 2024-04-26T07:30:07.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.207+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f9c06bbc0 con 0x7f4f7c038da0 2024-04-26T07:30:07.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.207+0000 7f4f8a7fc700 1 -- 172.21.15.31:0/2362799999 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7f4f9c06bbc0 con 0x7f4f7c038da0 2024-04-26T07:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.208+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 >> v1:172.21.15.31:6816/39613 conn(0x7f4f7c038da0 legacy=0x7f4f7c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.208+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f9c05b970 msgr2=0x7f4f9c149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.208+0000 7f4fa3573700 1 --2- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f9c05b970 0x7f4f9c149180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4f8c00c000 tx=0x7f4f8c006df0).stop 2024-04-26T07:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.209+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 shutdown_connections 2024-04-26T07:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.209+0000 7f4fa3573700 1 --2- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4f9c1339b0 0x7f4f9c130930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.209+0000 7f4fa3573700 1 --2- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4f9c05b970 0x7f4f9c149180 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.209+0000 7f4fa3573700 1 --2- 172.21.15.31:0/2362799999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f9c1335d0 0x7f4f9c130440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.209+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 >> 172.21.15.31:0/2362799999 conn(0x7f4f9c060ee0 msgr2=0x7f4f9c132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.209+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 shutdown_connections 2024-04-26T07:30:07.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.209+0000 7f4fa3573700 1 -- 172.21.15.31:0/2362799999 wait complete. 2024-04-26T07:30:07.210 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T07:30:07.219 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T07:30:07.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:30:07.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.330+0000 7f13072b1700 1 Processor -- start 2024-04-26T07:30:07.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.330+0000 7f13072b1700 1 -- start start 2024-04-26T07:30:07.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f13072b1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f130013a120 0x7f1300096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f13072b1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013e950 0x7f1300140d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f13072b1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1300097020 con 0x7f1300139d40 2024-04-26T07:30:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f13072b1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13001395c0 con 0x7f130013a120 2024-04-26T07:30:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f13072b1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1300139860 con 0x7f130013e950 2024-04-26T07:30:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f130484c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f130013a120 0x7f1300096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f130584e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013e950 0x7f1300140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f130584e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013e950 0x7f1300140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59030/0 (socket says 172.21.15.31:59030) 2024-04-26T07:30:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f130484c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f130013a120 0x7f1300096320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38290/0 (socket says 172.21.15.31:38290) 2024-04-26T07:30:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f130584e700 1 -- 172.21.15.31:0/2280994866 learned_addr learned my addr 172.21.15.31:0/2280994866 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.331+0000 7f130504d700 1 --1- 172.21.15.31:0/2280994866 >> v1:172.21.15.31:6789/0 conn(0x7f1300139d40 0x7f1300097740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60190/0 (socket says 172.21.15.31:60190) 2024-04-26T07:30:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f130484c700 1 -- 172.21.15.31:0/2280994866 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013e950 msgr2=0x7f1300140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f130484c700 1 --2- 172.21.15.31:0/2280994866 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013e950 0x7f1300140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f130484c700 1 -- 172.21.15.31:0/2280994866 >> v1:172.21.15.31:6789/0 conn(0x7f1300139d40 legacy=0x7f1300097740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f130484c700 1 -- 172.21.15.31:0/2280994866 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300139b20 con 0x7f130013a120 2024-04-26T07:30:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f130584e700 1 --2- 172.21.15.31:0/2280994866 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013e950 0x7f1300140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f130484c700 1 --2- 172.21.15.31:0/2280994866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f130013a120 0x7f1300096320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f12fc002f70 tx=0x7f12fc006df0).ready entity=mon.0 client_cookie=21255eb3b443dfaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f12effff700 1 -- 172.21.15.31:0/2280994866 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12fc00d570 con 0x7f130013a120 2024-04-26T07:30:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f12effff700 1 -- 172.21.15.31:0/2280994866 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc000e90 con 0x7f130013a120 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f12effff700 1 -- 172.21.15.31:0/2280994866 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12fc00d8c0 con 0x7f130013a120 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f13072b1700 1 -- 172.21.15.31:0/2280994866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f130013a120 msgr2=0x7f1300096320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f13072b1700 1 --2- 172.21.15.31:0/2280994866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f130013a120 0x7f1300096320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f12fc002f70 tx=0x7f12fc006df0).stop 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f13072b1700 1 -- 172.21.15.31:0/2280994866 shutdown_connections 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f13072b1700 1 --2- 172.21.15.31:0/2280994866 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013e950 0x7f1300140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f13072b1700 1 --2- 172.21.15.31:0/2280994866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f130013a120 0x7f1300096320 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.332+0000 7f13072b1700 1 -- 172.21.15.31:0/2280994866 >> 172.21.15.31:0/2280994866 conn(0x7f13000613e0 msgr2=0x7f130006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.333+0000 7f13072b1700 1 -- 172.21.15.31:0/2280994866 shutdown_connections 2024-04-26T07:30:07.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.333+0000 7f13072b1700 1 -- 172.21.15.31:0/2280994866 wait complete. 2024-04-26T07:30:07.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.333+0000 7f13072b1700 1 Processor -- start 2024-04-26T07:30:07.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.333+0000 7f13072b1700 1 -- start start 2024-04-26T07:30:07.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f13072b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1300139d40 0x7f1300063b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f13072b1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013a120 0x7f1300062fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f13072b1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f130013e950 0x7f1300146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f13072b1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130013d430 con 0x7f1300139d40 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f13072b1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13001460c0 con 0x7f130013e950 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f13072b1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130013da50 con 0x7f130013a120 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130484c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013a120 0x7f1300062fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130504d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1300139d40 0x7f1300063b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130484c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013a120 0x7f1300062fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59034/0 (socket says 172.21.15.31:59034) 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130484c700 1 -- 172.21.15.31:0/296215313 learned_addr learned my addr 172.21.15.31:0/296215313 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130584e700 1 --2- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f130013e950 0x7f1300146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130484c700 1 -- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f130013e950 msgr2=0x7f1300146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130484c700 1 --2- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f130013e950 0x7f1300146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130484c700 1 -- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1300139d40 msgr2=0x7f1300063b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130484c700 1 --2- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1300139d40 0x7f1300063b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130484c700 1 -- 172.21.15.31:0/296215313 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009530 con 0x7f130013a120 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130504d700 1 --2- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1300139d40 0x7f1300063b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.334+0000 7f130584e700 1 --2- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f130013e950 0x7f1300146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.335+0000 7f130484c700 1 --2- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013a120 0x7f1300062fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f12fc002f70 tx=0x7f12fc014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.335+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12fc013de0 con 0x7f130013a120 2024-04-26T07:30:07.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.335+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc01e400 con 0x7f130013a120 2024-04-26T07:30:07.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.335+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc00b180 con 0x7f130013a120 2024-04-26T07:30:07.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.335+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12fc01e760 con 0x7f130013a120 2024-04-26T07:30:07.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.335+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1300065470 con 0x7f130013a120 2024-04-26T07:30:07.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.336+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1300062d30 con 0x7f130013a120 2024-04-26T07:30:07.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.336+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f12fc025030 con 0x7f130013a120 2024-04-26T07:30:07.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.336+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f12fc04b740 con 0x7f130013a120 2024-04-26T07:30:07.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.336+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 --> v1:172.21.15.31:6808/40241 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12e0045600 con 0x7f12e0041910 2024-04-26T07:30:07.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.336+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12fc04dcb0 con 0x7f130013a120 2024-04-26T07:30:07.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.337+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 <== osd.1 v1:172.21.15.31:6808/40241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f12e0045600 con 0x7f12e0041910 2024-04-26T07:30:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.351+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 --> v1:172.21.15.31:6808/40241 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f130006bbc0 con 0x7f12e0041910 2024-04-26T07:30:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.351+0000 7f12ee7fc700 1 -- 172.21.15.31:0/296215313 <== osd.1 v1:172.21.15.31:6808/40241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f130006bbc0 con 0x7f12e0041910 2024-04-26T07:30:07.352 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-26T07:30:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-04-26T07:30:07.352 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-26T07:30:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 >> v1:172.21.15.31:6808/40241 conn(0x7f12e0041910 legacy=0x7f12e0043d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 >> v1:172.21.15.31:6816/39613 conn(0x7f12e0038da0 legacy=0x7f12e003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013a120 msgr2=0x7f1300062fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f13072b1700 1 --2- 172.21.15.31:0/296215313 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f130013a120 0x7f1300062fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f12fc002f70 tx=0x7f12fc014000).stop 2024-04-26T07:30:07.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f130584e700 1 -- 172.21.15.31:0/296215313 reap_dead start 2024-04-26T07:30:07.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 shutdown_connections 2024-04-26T07:30:07.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 >> 172.21.15.31:0/296215313 conn(0x7f13000613e0 msgr2=0x7f13001369a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 shutdown_connections 2024-04-26T07:30:07.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.352+0000 7f13072b1700 1 -- 172.21.15.31:0/296215313 wait complete. 2024-04-26T07:30:07.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T07:30:07.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.469+0000 7f8d57e3f700 1 Processor -- start 2024-04-26T07:30:07.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d57e3f700 1 -- start start 2024-04-26T07:30:07.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d57e3f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d50067500 0x7f8d5009a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d57e3f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50136d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d57e3f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5009b670 con 0x7f8d5009bc70 2024-04-26T07:30:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d57e3f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d501361b0 con 0x7f8d50067500 2024-04-26T07:30:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d57e3f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5009b400 con 0x7f8d5009c0a0 2024-04-26T07:30:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d55bdb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d50067500 0x7f8d5009a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d563dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d553da700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8d5009bc70 0x7f8d50136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43128/0 (socket says 172.21.15.31:43128) 2024-04-26T07:30:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d553da700 1 -- 172.21.15.31:0/1175888252 learned_addr learned my addr 172.21.15.31:0/1175888252 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d563dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50136d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47728/0 (socket says 172.21.15.31:47728) 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.470+0000 7f8d55bdb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d50067500 0x7f8d5009a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42330/0 (socket says 172.21.15.31:42330) 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d55bdb700 1 -- 172.21.15.31:0/1175888252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 msgr2=0x7f8d50136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d55bdb700 1 --2- 172.21.15.31:0/1175888252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d55bdb700 1 -- 172.21.15.31:0/1175888252 >> v1:172.21.15.31:6789/0 conn(0x7f8d5009bc70 legacy=0x7f8d50136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d54bd9700 1 -- 172.21.15.31:0/1175888252 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438821447 0 0) 0x7f8d5009b670 con 0x7f8d5009bc70 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d55bdb700 1 -- 172.21.15.31:0/1175888252 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d501363a0 con 0x7f8d50067500 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d55bdb700 1 --2- 172.21.15.31:0/1175888252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d50067500 0x7f8d5009a8f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8d44002f70 tx=0x7f8d44006df0).ready entity=mon.0 client_cookie=c8fcb8c46b9d54f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d54bd9700 1 -- 172.21.15.31:0/1175888252 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d4400d570 con 0x7f8d50067500 2024-04-26T07:30:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d54bd9700 1 -- 172.21.15.31:0/1175888252 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d44000e90 con 0x7f8d50067500 2024-04-26T07:30:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.471+0000 7f8d54bd9700 1 -- 172.21.15.31:0/1175888252 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d4400d8c0 con 0x7f8d50067500 2024-04-26T07:30:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.472+0000 7f8d57e3f700 1 -- 172.21.15.31:0/1175888252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d50067500 msgr2=0x7f8d5009a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.472+0000 7f8d57e3f700 1 --2- 172.21.15.31:0/1175888252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d50067500 0x7f8d5009a8f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8d44002f70 tx=0x7f8d44006df0).stop 2024-04-26T07:30:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.472+0000 7f8d57e3f700 1 -- 172.21.15.31:0/1175888252 shutdown_connections 2024-04-26T07:30:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.472+0000 7f8d57e3f700 1 --2- 172.21.15.31:0/1175888252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.472+0000 7f8d57e3f700 1 --2- 172.21.15.31:0/1175888252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d50067500 0x7f8d5009a8f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.472+0000 7f8d57e3f700 1 -- 172.21.15.31:0/1175888252 >> 172.21.15.31:0/1175888252 conn(0x7f8d5005cfb0 msgr2=0x7f8d50062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.472+0000 7f8d57e3f700 1 -- 172.21.15.31:0/1175888252 shutdown_connections 2024-04-26T07:30:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.472+0000 7f8d57e3f700 1 -- 172.21.15.31:0/1175888252 wait complete. 2024-04-26T07:30:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d57e3f700 1 Processor -- start 2024-04-26T07:30:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d57e3f700 1 -- start start 2024-04-26T07:30:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d57e3f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d50067500 0x7f8d50093d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d57e3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d5009bc70 0x7f8d50094d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d57e3f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d57e3f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500aa0a0 con 0x7f8d5009bc70 2024-04-26T07:30:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d57e3f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50094610 con 0x7f8d5009c0a0 2024-04-26T07:30:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d57e3f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50145b80 con 0x7f8d50067500 2024-04-26T07:30:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d55bdb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d50067500 0x7f8d50093d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d563dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d55bdb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d50067500 0x7f8d50093d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45546/0 (socket says 172.21.15.31:45546) 2024-04-26T07:30:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d563dc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50145e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47732/0 (socket says 172.21.15.31:47732) 2024-04-26T07:30:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d55bdb700 1 -- 172.21.15.31:0/2113515816 learned_addr learned my addr 172.21.15.31:0/2113515816 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.473+0000 7f8d553da700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d5009bc70 0x7f8d50094d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d55bdb700 1 -- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 msgr2=0x7f8d50145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d55bdb700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d55bdb700 1 -- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d5009bc70 msgr2=0x7f8d50094d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d55bdb700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d5009bc70 0x7f8d50094d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d55bdb700 1 -- 172.21.15.31:0/2113515816 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4400b180 con 0x7f8d50067500 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d553da700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d5009bc70 0x7f8d50094d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d55bdb700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d50067500 0x7f8d50093d40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f8d500947a0 tx=0x7f8d44014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d42ffd700 1 -- 172.21.15.31:0/2113515816 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d44016070 con 0x7f8d50067500 2024-04-26T07:30:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d42ffd700 1 -- 172.21.15.31:0/2113515816 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d440138d0 con 0x7f8d50067500 2024-04-26T07:30:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d50095270 con 0x7f8d50067500 2024-04-26T07:30:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d42ffd700 1 -- 172.21.15.31:0/2113515816 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d44013c30 con 0x7f8d50067500 2024-04-26T07:30:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.474+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d50093740 con 0x7f8d50067500 2024-04-26T07:30:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.475+0000 7f8d42ffd700 1 -- 172.21.15.31:0/2113515816 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8d44025030 con 0x7f8d50067500 2024-04-26T07:30:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.475+0000 7f8d42ffd700 1 -- 172.21.15.31:0/2113515816 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8d4404b7d0 con 0x7f8d50067500 2024-04-26T07:30:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.475+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d50093b90 con 0x7f8d50067500 2024-04-26T07:30:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.478+0000 7f8d42ffd700 1 -- 172.21.15.31:0/2113515816 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8d44028610 con 0x7f8d50067500 2024-04-26T07:30:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.595+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d5006bbc0 con 0x7f8d30038ec0 2024-04-26T07:30:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.595+0000 7f8d42ffd700 1 -- 172.21.15.31:0/2113515816 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f8d5006bbc0 con 0x7f8d30038ec0 2024-04-26T07:30:07.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 >> v1:172.21.15.31:6816/39613 conn(0x7f8d30038ec0 legacy=0x7f8d3003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d50067500 msgr2=0x7f8d50093d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d50067500 0x7f8d50093d40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f8d500947a0 tx=0x7f8d44014000).stop 2024-04-26T07:30:07.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 shutdown_connections 2024-04-26T07:30:07.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d50067500 0x7f8d50093d40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d5009c0a0 0x7f8d50145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 --2- 172.21.15.31:0/2113515816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d5009bc70 0x7f8d50094d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 >> 172.21.15.31:0/2113515816 conn(0x7f8d5005cfb0 msgr2=0x7f8d5013b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 shutdown_connections 2024-04-26T07:30:07.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.597+0000 7f8d57e3f700 1 -- 172.21.15.31:0/2113515816 wait complete. 2024-04-26T07:30:07.599 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T07:30:07.607 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T07:30:07.607 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:30:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.717+0000 7f0178b7a700 1 Processor -- start 2024-04-26T07:30:07.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.717+0000 7f0178b7a700 1 -- start start 2024-04-26T07:30:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0178b7a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f01741334f0 0x7f0174136370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0178b7a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174064850 0x7f01741338d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0178b7a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174136b50 0x7f01740a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0178b7a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0174132e20 con 0x7f01741334f0 2024-04-26T07:30:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0178b7a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0174133dc0 con 0x7f0174064850 2024-04-26T07:30:07.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0178b7a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0174068480 con 0x7f0174136b50 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0171d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174064850 0x7f01741338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f017259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f01741334f0 0x7f0174136370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0172d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174136b50 0x7f01740a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f017259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f01741334f0 0x7f0174136370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42338/0 (socket says 172.21.15.31:42338) 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0172d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174136b50 0x7f01740a81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45558/0 (socket says 172.21.15.31:45558) 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f0171d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174064850 0x7f01741338d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47734/0 (socket says 172.21.15.31:47734) 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.718+0000 7f017259c700 1 -- 172.21.15.31:0/3226473795 learned_addr learned my addr 172.21.15.31:0/3226473795 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f0172d9d700 1 -- 172.21.15.31:0/3226473795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174064850 msgr2=0x7f01741338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:07.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f0172d9d700 1 --2- 172.21.15.31:0/3226473795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174064850 0x7f01741338d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f0172d9d700 1 -- 172.21.15.31:0/3226473795 >> v2:172.21.15.31:3300/0 conn(0x7f01741334f0 msgr2=0x7f0174136370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f0172d9d700 1 --2- 172.21.15.31:0/3226473795 >> v2:172.21.15.31:3300/0 conn(0x7f01741334f0 0x7f0174136370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f0172d9d700 1 -- 172.21.15.31:0/3226473795 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0174133010 con 0x7f0174136b50 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f017259c700 1 --2- 172.21.15.31:0/3226473795 >> v2:172.21.15.31:3300/0 conn(0x7f01741334f0 0x7f0174136370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f0172d9d700 1 --2- 172.21.15.31:0/3226473795 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174136b50 0x7f01740a81d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f016c0032f0 tx=0x7f016c00b470).ready entity=mon.2 client_cookie=bcfc83f95889a1aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f017159a700 1 -- 172.21.15.31:0/3226473795 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f016c00dc40 con 0x7f0174136b50 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f017159a700 1 -- 172.21.15.31:0/3226473795 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c00dda0 con 0x7f0174136b50 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f017159a700 1 -- 172.21.15.31:0/3226473795 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f016c010660 con 0x7f0174136b50 2024-04-26T07:30:07.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f0178b7a700 1 -- 172.21.15.31:0/3226473795 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174136b50 msgr2=0x7f01740a81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.719+0000 7f0178b7a700 1 --2- 172.21.15.31:0/3226473795 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174136b50 0x7f01740a81d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f016c0032f0 tx=0x7f016c00b470).stop 2024-04-26T07:30:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.720+0000 7f0178b7a700 1 -- 172.21.15.31:0/3226473795 shutdown_connections 2024-04-26T07:30:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.720+0000 7f0178b7a700 1 --2- 172.21.15.31:0/3226473795 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174136b50 0x7f01740a81d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.720+0000 7f0178b7a700 1 --2- 172.21.15.31:0/3226473795 >> v2:172.21.15.31:3300/0 conn(0x7f01741334f0 0x7f0174136370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.720+0000 7f0178b7a700 1 --2- 172.21.15.31:0/3226473795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174064850 0x7f01741338d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.720+0000 7f0178b7a700 1 -- 172.21.15.31:0/3226473795 >> 172.21.15.31:0/3226473795 conn(0x7f01740613e0 msgr2=0x7f017406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.720+0000 7f0178b7a700 1 -- 172.21.15.31:0/3226473795 shutdown_connections 2024-04-26T07:30:07.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.720+0000 7f0178b7a700 1 -- 172.21.15.31:0/3226473795 wait complete. 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.720+0000 7f0178b7a700 1 Processor -- start 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0178b7a700 1 -- start start 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0178b7a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174064850 0x7f0174067980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0178b7a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01741334f0 0x7f01740926d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0178b7a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174136b50 0x7f01741449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0178b7a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0174093250 con 0x7f01741334f0 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0178b7a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0174093be0 con 0x7f0174136b50 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0178b7a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0174093e80 con 0x7f0174064850 2024-04-26T07:30:07.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f017259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174064850 0x7f0174067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0171d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01741334f0 0x7f01740926d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0172d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174136b50 0x7f01741449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f017259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174064850 0x7f0174067980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45560/0 (socket says 172.21.15.31:45560) 2024-04-26T07:30:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f017259c700 1 -- 172.21.15.31:0/194834225 learned_addr learned my addr 172.21.15.31:0/194834225 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0172d9d700 1 -- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174064850 msgr2=0x7f0174067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0172d9d700 1 --2- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174064850 0x7f0174067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0172d9d700 1 -- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01741334f0 msgr2=0x7f01740926d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0172d9d700 1 --2- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01741334f0 0x7f01740926d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.721+0000 7f0172d9d700 1 -- 172.21.15.31:0/194834225 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c00b1e0 con 0x7f0174136b50 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.722+0000 7f0171d9b700 1 --2- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01741334f0 0x7f01740926d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.722+0000 7f017259c700 1 --2- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0174064850 0x7f0174067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.722+0000 7f0172d9d700 1 --2- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174136b50 0x7f01741449d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f016c0032f0 tx=0x7f016c00b470).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.722+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f016c01e070 con 0x7f0174136b50 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.722+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c023600 con 0x7f0174136b50 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.722+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c00b710 con 0x7f0174136b50 2024-04-26T07:30:07.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.722+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f016c023960 con 0x7f0174136b50 2024-04-26T07:30:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.722+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0174093750 con 0x7f0174136b50 2024-04-26T07:30:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.723+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f016c02a070 con 0x7f0174136b50 2024-04-26T07:30:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.723+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01740923e0 con 0x7f0174136b50 2024-04-26T07:30:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.723+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f016c04bdd0 con 0x7f0174136b50 2024-04-26T07:30:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.723+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 --> v1:172.21.15.31:6812/40244 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01580455f0 con 0x7f01580419a0 2024-04-26T07:30:07.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.723+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f016c007cb0 con 0x7f0174136b50 2024-04-26T07:30:07.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.724+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 <== osd.2 v1:172.21.15.31:6812/40244 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f01580455f0 con 0x7f01580419a0 2024-04-26T07:30:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.738+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 --> v1:172.21.15.31:6812/40244 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0174132810 con 0x7f01580419a0 2024-04-26T07:30:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.738+0000 7f016b7fe700 1 -- 172.21.15.31:0/194834225 <== osd.2 v1:172.21.15.31:6812/40244 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f0174132810 con 0x7f01580419a0 2024-04-26T07:30:07.739 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-26T07:30:07.739 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-04-26T07:30:07.739 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-26T07:30:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 >> v1:172.21.15.31:6812/40244 conn(0x7f01580419a0 legacy=0x7f0158043e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 >> v1:172.21.15.31:6816/39613 conn(0x7f0158038f50 legacy=0x7f015803b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174136b50 msgr2=0x7f01741449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0178b7a700 1 --2- 172.21.15.31:0/194834225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0174136b50 0x7f01741449d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f016c0032f0 tx=0x7f016c00b470).stop 2024-04-26T07:30:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0172d9d700 1 -- 172.21.15.31:0/194834225 reap_dead start 2024-04-26T07:30:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 shutdown_connections 2024-04-26T07:30:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 >> 172.21.15.31:0/194834225 conn(0x7f01740613e0 msgr2=0x7f0174062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 shutdown_connections 2024-04-26T07:30:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.739+0000 7f0178b7a700 1 -- 172.21.15.31:0/194834225 wait complete. 2024-04-26T07:30:07.749 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T07:30:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.856+0000 7f81fcefe700 1 Processor -- start 2024-04-26T07:30:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.856+0000 7f81fcefe700 1 -- start start 2024-04-26T07:30:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81fcefe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81fcefe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f813ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81fcefe700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f8137620 con 0x7f81f809ff30 2024-04-26T07:30:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81fcefe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80a4e20 con 0x7f81f813c7d0 2024-04-26T07:30:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81fcefe700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8138320 con 0x7f81f8137a50 2024-04-26T07:30:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f5d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f81f809ff30 0x7f81f80a3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43138/0 (socket says 172.21.15.31:43138) 2024-04-26T07:30:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f5d9b700 1 -- 172.21.15.31:0/2427346537 learned_addr learned my addr 172.21.15.31:0/2427346537 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f813ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f659c700 1 -- 172.21.15.31:0/2427346537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 msgr2=0x7f81f813ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f659c700 1 --2- 172.21.15.31:0/2427346537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f813ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f659c700 1 -- 172.21.15.31:0/2427346537 >> v1:172.21.15.31:6789/0 conn(0x7f81f809ff30 legacy=0x7f81f80a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f659c700 1 -- 172.21.15.31:0/2427346537 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f80a3960 con 0x7f81f8137a50 2024-04-26T07:30:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f559a700 1 -- 172.21.15.31:0/2427346537 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171758756 0 0) 0x7f81f8137620 con 0x7f81f809ff30 2024-04-26T07:30:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f6d9d700 1 --2- 172.21.15.31:0/2427346537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f813ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f659c700 1 --2- 172.21.15.31:0/2427346537 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8137e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f81f80a4c60 tx=0x7f81ec006df0).ready entity=mon.2 client_cookie=d6b7e18fa997505d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f559a700 1 -- 172.21.15.31:0/2427346537 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81ec00d570 con 0x7f81f8137a50 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f559a700 1 -- 172.21.15.31:0/2427346537 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec000e90 con 0x7f81f8137a50 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.857+0000 7f81f559a700 1 -- 172.21.15.31:0/2427346537 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81ec00d8c0 con 0x7f81f8137a50 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.858+0000 7f81fcefe700 1 -- 172.21.15.31:0/2427346537 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 msgr2=0x7f81f8137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.858+0000 7f81fcefe700 1 --2- 172.21.15.31:0/2427346537 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8137e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f81f80a4c60 tx=0x7f81ec006df0).stop 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.858+0000 7f81fcefe700 1 -- 172.21.15.31:0/2427346537 shutdown_connections 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.858+0000 7f81fcefe700 1 --2- 172.21.15.31:0/2427346537 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f813ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.858+0000 7f81fcefe700 1 --2- 172.21.15.31:0/2427346537 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8137e30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.858+0000 7f81fcefe700 1 -- 172.21.15.31:0/2427346537 >> 172.21.15.31:0/2427346537 conn(0x7f81f8060ee0 msgr2=0x7f81f80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.858+0000 7f81fcefe700 1 -- 172.21.15.31:0/2427346537 shutdown_connections 2024-04-26T07:30:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.858+0000 7f81fcefe700 1 -- 172.21.15.31:0/2427346537 wait complete. 2024-04-26T07:30:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.859+0000 7f81fcefe700 1 Processor -- start 2024-04-26T07:30:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.859+0000 7f81fcefe700 1 -- start start 2024-04-26T07:30:07.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.859+0000 7f81fcefe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f809ff30 0x7f81f8061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.859+0000 7f81fcefe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8139740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.859+0000 7f81fcefe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f8139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.859+0000 7f81fcefe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80a6f00 con 0x7f81f809ff30 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.859+0000 7f81fcefe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8063560 con 0x7f81f813c7d0 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.859+0000 7f81fcefe700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8061db0 con 0x7f81f8137a50 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8139740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f8139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8139740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45578/0 (socket says 172.21.15.31:45578) 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f809ff30 0x7f81f8061790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 -- 172.21.15.31:0/3940210114 learned_addr learned my addr 172.21.15.31:0/3940210114 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f8139c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47772/0 (socket says 172.21.15.31:47772) 2024-04-26T07:30:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 -- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 msgr2=0x7f81f8139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f8139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 -- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f809ff30 msgr2=0x7f81f8061790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f809ff30 0x7f81f8061790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 -- 172.21.15.31:0/3940210114 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0009470 con 0x7f81f8137a50 2024-04-26T07:30:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f659c700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f809ff30 0x7f81f8061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f6d9d700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f8139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81f5d9b700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8139740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f81e8000bc0 tx=0x7f81e8007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81e77fe700 1 -- 172.21.15.31:0/3940210114 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e80070d0 con 0x7f81f8137a50 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81e77fe700 1 -- 172.21.15.31:0/3940210114 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e8007230 con 0x7f81f8137a50 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec00b180 con 0x7f81f8137a50 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81e77fe700 1 -- 172.21.15.31:0/3940210114 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e8005610 con 0x7f81f8137a50 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.860+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f8062000 con 0x7f81f8137a50 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.861+0000 7f81e77fe700 1 -- 172.21.15.31:0/3940210114 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f81e801a060 con 0x7f81f8137a50 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.861+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f80a7070 con 0x7f81f8137a50 2024-04-26T07:30:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.861+0000 7f81e77fe700 1 -- 172.21.15.31:0/3940210114 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f81e804a010 con 0x7f81f8137a50 2024-04-26T07:30:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.864+0000 7f81e77fe700 1 -- 172.21.15.31:0/3940210114 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f81f80a7070 con 0x7f81f8137a50 2024-04-26T07:30:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.981+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f81f80a7070 con 0x7f81d4038da0 2024-04-26T07:30:07.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.982+0000 7f81e77fe700 1 -- 172.21.15.31:0/3940210114 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f81f80a7070 con 0x7f81d4038da0 2024-04-26T07:30:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 >> v1:172.21.15.31:6816/39613 conn(0x7f81d4038da0 legacy=0x7f81d403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 msgr2=0x7f81f8139740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8139740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f81e8000bc0 tx=0x7f81e8007a40).stop 2024-04-26T07:30:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 shutdown_connections 2024-04-26T07:30:07.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81f813c7d0 0x7f81f8139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f809ff30 0x7f81f8061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 --2- 172.21.15.31:0/3940210114 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f81f8137a50 0x7f81f8139740 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:07.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 >> 172.21.15.31:0/3940210114 conn(0x7f81f8060ee0 msgr2=0x7f81f80a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:07.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 shutdown_connections 2024-04-26T07:30:07.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:07.983+0000 7f81fcefe700 1 -- 172.21.15.31:0/3940210114 wait complete. 2024-04-26T07:30:07.987 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T07:30:07.994 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T07:30:07.995 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:30:08.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.105+0000 7f7b2a871700 1 Processor -- start 2024-04-26T07:30:08.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.105+0000 7f7b2a871700 1 -- start start 2024-04-26T07:30:08.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b2a871700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b24134730 0x7f7b240a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b2a871700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065480 0x7f7b2405b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b2a871700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24065900 0x7f7b2405be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b2a871700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b24133db0 con 0x7f7b24134730 2024-04-26T07:30:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b2a871700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24064f80 con 0x7f7b24065480 2024-04-26T07:30:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b2a871700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24133fa0 con 0x7f7b24065900 2024-04-26T07:30:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b24134730 0x7f7b240a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b28e0e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24065900 0x7f7b2405be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065480 0x7f7b2405b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b24134730 0x7f7b240a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42368/0 (socket says 172.21.15.31:42368) 2024-04-26T07:30:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b28e0e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24065900 0x7f7b2405be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45586/0 (socket says 172.21.15.31:45586) 2024-04-26T07:30:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 -- 172.21.15.31:0/2401469536 learned_addr learned my addr 172.21.15.31:0/2401469536 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065480 0x7f7b2405b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47786/0 (socket says 172.21.15.31:47786) 2024-04-26T07:30:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 -- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24065900 msgr2=0x7f7b2405be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 --2- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24065900 0x7f7b2405be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 -- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065480 msgr2=0x7f7b2405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 --2- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065480 0x7f7b2405b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 -- 172.21.15.31:0/2401469536 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24134240 con 0x7f7b24134730 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b28e0e700 1 --2- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24065900 0x7f7b2405be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b23fff700 1 --2- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24134730 0x7f7b240a9a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f7b0c002f70 tx=0x7f7b0c006e50).ready entity=mon.0 client_cookie=b2a7bf10fb45b25c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.106+0000 7f7b22ffd700 1 -- 172.21.15.31:0/2401469536 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0c00d570 con 0x7f7b24134730 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b22ffd700 1 -- 172.21.15.31:0/2401469536 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c000e90 con 0x7f7b24134730 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b22ffd700 1 -- 172.21.15.31:0/2401469536 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0c00d900 con 0x7f7b24134730 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 -- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24134730 msgr2=0x7f7b240a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 --2- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24134730 0x7f7b240a9a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f7b0c002f70 tx=0x7f7b0c006e50).stop 2024-04-26T07:30:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 -- 172.21.15.31:0/2401469536 shutdown_connections 2024-04-26T07:30:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 --2- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24065900 0x7f7b2405be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 --2- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24134730 0x7f7b240a9a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 --2- 172.21.15.31:0/2401469536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065480 0x7f7b2405b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 -- 172.21.15.31:0/2401469536 >> 172.21.15.31:0/2401469536 conn(0x7f7b240613e0 msgr2=0x7f7b2406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 -- 172.21.15.31:0/2401469536 shutdown_connections 2024-04-26T07:30:08.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.107+0000 7f7b2a871700 1 -- 172.21.15.31:0/2401469536 wait complete. 2024-04-26T07:30:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.108+0000 7f7b2a871700 1 Processor -- start 2024-04-26T07:30:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.108+0000 7f7b2a871700 1 -- start start 2024-04-26T07:30:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b2a871700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24065480 0x7f7b240946e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b2a871700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065900 0x7f7b24146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b2a871700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24134730 0x7f7b24146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b2a871700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240965d0 con 0x7f7b24065480 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b2a871700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240950b0 con 0x7f7b24065900 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b2a871700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240977b0 con 0x7f7b24134730 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b28e0e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24134730 0x7f7b24146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065900 0x7f7b24146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b28e0e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24134730 0x7f7b24146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45588/0 (socket says 172.21.15.31:45588) 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b23fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24065480 0x7f7b240946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b28e0e700 1 -- 172.21.15.31:0/1959283416 learned_addr learned my addr 172.21.15.31:0/1959283416 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b237fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065900 0x7f7b24146a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47788/0 (socket says 172.21.15.31:47788) 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b237fe700 1 -- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24134730 msgr2=0x7f7b24146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b237fe700 1 --2- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24134730 0x7f7b24146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b237fe700 1 -- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24065480 msgr2=0x7f7b240946e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b237fe700 1 --2- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24065480 0x7f7b240946e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b237fe700 1 -- 172.21.15.31:0/1959283416 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c009470 con 0x7f7b24065900 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b28e0e700 1 --2- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7b24134730 0x7f7b24146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b23fff700 1 --2- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b24065480 0x7f7b240946e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:08.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b237fe700 1 --2- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065900 0x7f7b24146a50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7b1400c000 tx=0x7f7b14006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b14010780 con 0x7f7b24065900 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b140108e0 con 0x7f7b24065900 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.109+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b14010c40 con 0x7f7b24065900 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.110+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0c00b1e0 con 0x7f7b24065900 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.110+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b24095c80 con 0x7f7b24065900 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.110+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7b1401b410 con 0x7f7b24065900 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.110+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b240943b0 con 0x7f7b24065900 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.111+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7b1404a880 con 0x7f7b24065900 2024-04-26T07:30:08.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.111+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 --> v1:172.21.15.31:6804/40243 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b08045600 con 0x7f7b08041910 2024-04-26T07:30:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.111+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b1404d180 con 0x7f7b24065900 2024-04-26T07:30:08.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.112+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 <== osd.3 v1:172.21.15.31:6804/40243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f7b08045600 con 0x7f7b08041910 2024-04-26T07:30:08.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.126+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 --> v1:172.21.15.31:6804/40243 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b2406bbc0 con 0x7f7b08041910 2024-04-26T07:30:08.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.126+0000 7f7b217fa700 1 -- 172.21.15.31:0/1959283416 <== osd.3 v1:172.21.15.31:6804/40243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f7b2406bbc0 con 0x7f7b08041910 2024-04-26T07:30:08.127 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-26T07:30:08.127 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-04-26T07:30:08.128 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-26T07:30:08.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.126+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 >> v1:172.21.15.31:6804/40243 conn(0x7f7b08041910 legacy=0x7f7b08043d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.126+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 >> v1:172.21.15.31:6816/39613 conn(0x7f7b08038da0 legacy=0x7f7b0803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.126+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065900 msgr2=0x7f7b24146a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.126+0000 7f7b2a871700 1 --2- 172.21.15.31:0/1959283416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b24065900 0x7f7b24146a50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7b1400c000 tx=0x7f7b14006df0).stop 2024-04-26T07:30:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.126+0000 7f7b28e0e700 1 -- 172.21.15.31:0/1959283416 reap_dead start 2024-04-26T07:30:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.127+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 shutdown_connections 2024-04-26T07:30:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.127+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 >> 172.21.15.31:0/1959283416 conn(0x7f7b240613e0 msgr2=0x7f7b241312c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.127+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 shutdown_connections 2024-04-26T07:30:08.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.127+0000 7f7b2a871700 1 -- 172.21.15.31:0/1959283416 wait complete. 2024-04-26T07:30:08.137 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T07:30:08.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.243+0000 7ff2138f5700 1 Processor -- start 2024-04-26T07:30:08.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff2138f5700 1 -- start start 2024-04-26T07:30:08.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff2138f5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c09a8f0 0x7ff20c136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff2138f5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c136b50 0x7ff20c140a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff2138f5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c09b670 con 0x7ff20c067500 2024-04-26T07:30:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff2138f5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c09c380 con 0x7ff20c136b50 2024-04-26T07:30:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff2138f5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c1361b0 con 0x7ff20c09a8f0 2024-04-26T07:30:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff210e90700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c09a8f0 0x7ff20c136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff211e92700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c136b50 0x7ff20c140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff211691700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff20c067500 0x7ff20c09bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:43148/0 (socket says 172.21.15.31:43148) 2024-04-26T07:30:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.244+0000 7ff211691700 1 -- 172.21.15.31:0/2355188812 learned_addr learned my addr 172.21.15.31:0/2355188812 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff1fbfff700 1 -- 172.21.15.31:0/2355188812 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336703710 0 0) 0x7ff20c09b670 con 0x7ff20c067500 2024-04-26T07:30:08.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff210e90700 1 -- 172.21.15.31:0/2355188812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c136b50 msgr2=0x7ff20c140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff210e90700 1 --2- 172.21.15.31:0/2355188812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c136b50 0x7ff20c140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff210e90700 1 -- 172.21.15.31:0/2355188812 >> v1:172.21.15.31:6789/0 conn(0x7ff20c067500 legacy=0x7ff20c09bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff210e90700 1 -- 172.21.15.31:0/2355188812 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c09b400 con 0x7ff20c09a8f0 2024-04-26T07:30:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff211e92700 1 --2- 172.21.15.31:0/2355188812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c136b50 0x7ff20c140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff210e90700 1 --2- 172.21.15.31:0/2355188812 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c09a8f0 0x7ff20c136660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff1fc002f70 tx=0x7ff1fc006df0).ready entity=mon.2 client_cookie=bd7a2627c6d84f1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff1fbfff700 1 -- 172.21.15.31:0/2355188812 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc00d570 con 0x7ff20c09a8f0 2024-04-26T07:30:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff1fbfff700 1 -- 172.21.15.31:0/2355188812 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc000e90 con 0x7ff20c09a8f0 2024-04-26T07:30:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff1fbfff700 1 -- 172.21.15.31:0/2355188812 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc00d8c0 con 0x7ff20c09a8f0 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff2138f5700 1 -- 172.21.15.31:0/2355188812 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c09a8f0 msgr2=0x7ff20c136660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff2138f5700 1 --2- 172.21.15.31:0/2355188812 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c09a8f0 0x7ff20c136660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff1fc002f70 tx=0x7ff1fc006df0).stop 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff2138f5700 1 -- 172.21.15.31:0/2355188812 shutdown_connections 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff2138f5700 1 --2- 172.21.15.31:0/2355188812 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c136b50 0x7ff20c140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff2138f5700 1 --2- 172.21.15.31:0/2355188812 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c09a8f0 0x7ff20c136660 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.245+0000 7ff2138f5700 1 -- 172.21.15.31:0/2355188812 >> 172.21.15.31:0/2355188812 conn(0x7ff20c05cfb0 msgr2=0x7ff20c062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.246+0000 7ff2138f5700 1 -- 172.21.15.31:0/2355188812 shutdown_connections 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.246+0000 7ff2138f5700 1 -- 172.21.15.31:0/2355188812 wait complete. 2024-04-26T07:30:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.246+0000 7ff2138f5700 1 Processor -- start 2024-04-26T07:30:08.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.246+0000 7ff2138f5700 1 -- start start 2024-04-26T07:30:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff2138f5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c067500 0x7ff20c094fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff2138f5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c09a8f0 0x7ff20c093610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff2138f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c136b50 0x7ff20c091f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff2138f5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c095750 con 0x7ff20c136b50 2024-04-26T07:30:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff2138f5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0947d0 con 0x7ff20c09a8f0 2024-04-26T07:30:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff2138f5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c093e60 con 0x7ff20c067500 2024-04-26T07:30:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff211691700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c067500 0x7ff20c094fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff210e90700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c09a8f0 0x7ff20c093610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff211e92700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c136b50 0x7ff20c091f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff210e90700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c09a8f0 0x7ff20c093610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47806/0 (socket says 172.21.15.31:47806) 2024-04-26T07:30:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff211691700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c067500 0x7ff20c094fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45596/0 (socket says 172.21.15.31:45596) 2024-04-26T07:30:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff210e90700 1 -- 172.21.15.31:0/4212890945 learned_addr learned my addr 172.21.15.31:0/4212890945 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff210e90700 1 -- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c067500 msgr2=0x7ff20c094fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff210e90700 1 --2- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c067500 0x7ff20c094fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff210e90700 1 -- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c136b50 msgr2=0x7ff20c091f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff210e90700 1 --2- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c136b50 0x7ff20c091f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.247+0000 7ff210e90700 1 -- 172.21.15.31:0/4212890945 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204009470 con 0x7ff20c09a8f0 2024-04-26T07:30:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.248+0000 7ff211e92700 1 --2- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c136b50 0x7ff20c091f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.248+0000 7ff210e90700 1 --2- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c09a8f0 0x7ff20c093610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff20c0a9270 tx=0x7ff1fc014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.248+0000 7ff1fa7fc700 1 -- 172.21.15.31:0/4212890945 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc013e50 con 0x7ff20c09a8f0 2024-04-26T07:30:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.248+0000 7ff1fa7fc700 1 -- 172.21.15.31:0/4212890945 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc01e400 con 0x7ff20c09a8f0 2024-04-26T07:30:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.248+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc00b180 con 0x7ff20c09a8f0 2024-04-26T07:30:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.248+0000 7ff1fa7fc700 1 -- 172.21.15.31:0/4212890945 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1fc01e760 con 0x7ff20c09a8f0 2024-04-26T07:30:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.248+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c13dba0 con 0x7ff20c09a8f0 2024-04-26T07:30:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.249+0000 7ff1fa7fc700 1 -- 172.21.15.31:0/4212890945 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff1fc025030 con 0x7ff20c09a8f0 2024-04-26T07:30:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.249+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c094c70 con 0x7ff20c09a8f0 2024-04-26T07:30:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.249+0000 7ff1fa7fc700 1 -- 172.21.15.31:0/4212890945 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff1fc04b7f0 con 0x7ff20c09a8f0 2024-04-26T07:30:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.252+0000 7ff1fa7fc700 1 -- 172.21.15.31:0/4212890945 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff1fc028830 con 0x7ff20c09a8f0 2024-04-26T07:30:08.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.368+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff20c06bbc0 con 0x7ff1ec038e30 2024-04-26T07:30:08.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.368+0000 7ff1fa7fc700 1 -- 172.21.15.31:0/4212890945 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7ff20c06bbc0 con 0x7ff1ec038e30 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 >> v1:172.21.15.31:6816/39613 conn(0x7ff1ec038e30 legacy=0x7ff1ec03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c09a8f0 msgr2=0x7ff20c093610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 --2- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c09a8f0 0x7ff20c093610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff20c0a9270 tx=0x7ff1fc014000).stop 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 shutdown_connections 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 --2- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff20c067500 0x7ff20c094fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 --2- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff20c136b50 0x7ff20c091f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 --2- 172.21.15.31:0/4212890945 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff20c09a8f0 0x7ff20c093610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 >> 172.21.15.31:0/4212890945 conn(0x7ff20c05cfb0 msgr2=0x7ff20c13aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 shutdown_connections 2024-04-26T07:30:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.370+0000 7ff2138f5700 1 -- 172.21.15.31:0/4212890945 wait complete. 2024-04-26T07:30:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T07:30:08.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:30:08.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.488+0000 7f663d8d5700 1 Processor -- start 2024-04-26T07:30:08.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.488+0000 7f663d8d5700 1 -- start start 2024-04-26T07:30:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f663d8d5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f66380ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f663d8d5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f663805cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f663d8d5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6638139510 0x7f66381399c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f663d8d5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663805b970 con 0x7f6638139510 2024-04-26T07:30:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f663d8d5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663805c3d0 con 0x7f66380aca60 2024-04-26T07:30:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f663d8d5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f663805d0a0 con 0x7f66380a8af0 2024-04-26T07:30:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f6636ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f66380ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6638139510 0x7f66381399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66367fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f663805cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6638139510 0x7f66381399c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42410/0 (socket says 172.21.15.31:42410) 2024-04-26T07:30:08.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f6636ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f66380ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:47808/0 (socket says 172.21.15.31:47808) 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66367fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f663805cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45610/0 (socket says 172.21.15.31:45610) 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 -- 172.21.15.31:0/620894119 learned_addr learned my addr 172.21.15.31:0/620894119 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 -- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 msgr2=0x7f663805cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f663805cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 -- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 msgr2=0x7f66380ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f66380ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 -- 172.21.15.31:0/620894119 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663805d300 con 0x7f6638139510 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66367fc700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f663805cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:08.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f6636ffd700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f66380ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f66377fe700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f66381399c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f66300032f0 tx=0x7f6630009290).ready entity=mon.0 client_cookie=90fde6d9d688a949 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f6635ffb700 1 -- 172.21.15.31:0/620894119 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663000b6c0 con 0x7f6638139510 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f6635ffb700 1 -- 172.21.15.31:0/620894119 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000b820 con 0x7f6638139510 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.489+0000 7f6635ffb700 1 -- 172.21.15.31:0/620894119 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663000b990 con 0x7f6638139510 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 -- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 msgr2=0x7f66381399c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f66381399c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f66300032f0 tx=0x7f6630009290).stop 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 -- 172.21.15.31:0/620894119 shutdown_connections 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f66381399c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f66380ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 --2- 172.21.15.31:0/620894119 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f663805cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 -- 172.21.15.31:0/620894119 >> 172.21.15.31:0/620894119 conn(0x7f6638066d50 msgr2=0x7f6638067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 -- 172.21.15.31:0/620894119 shutdown_connections 2024-04-26T07:30:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.490+0000 7f663d8d5700 1 -- 172.21.15.31:0/620894119 wait complete. 2024-04-26T07:30:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.491+0000 7f663d8d5700 1 Processor -- start 2024-04-26T07:30:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.491+0000 7f663d8d5700 1 -- start start 2024-04-26T07:30:08.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.491+0000 7f663d8d5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f66380ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.491+0000 7f663d8d5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f6638119920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.491+0000 7f663d8d5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f6638114fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.491+0000 7f663d8d5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66380ab750 con 0x7f6638139510 2024-04-26T07:30:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.491+0000 7f663d8d5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6638119020 con 0x7f66380aca60 2024-04-26T07:30:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.491+0000 7f663d8d5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66381174c0 con 0x7f66380a8af0 2024-04-26T07:30:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f6638114fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66367fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f6638119920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f6638114fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42420/0 (socket says 172.21.15.31:42420) 2024-04-26T07:30:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 -- 172.21.15.31:0/2796806200 learned_addr learned my addr 172.21.15.31:0/2796806200 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f6636ffd700 1 --2- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f66380ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 -- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 msgr2=0x7f66380ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 --2- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f66380ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 -- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 msgr2=0x7f6638119920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 --2- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f6638119920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 -- 172.21.15.31:0/2796806200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c00b180 con 0x7f6638139510 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f66377fe700 1 --2- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f6638114fd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f66300032f0 tx=0x7f6630016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f6627fff700 1 -- 172.21.15.31:0/2796806200 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663000b6c0 con 0x7f6638139510 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f6627fff700 1 -- 172.21.15.31:0/2796806200 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6630021670 con 0x7f6638139510 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662800b180 con 0x7f6638139510 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f6627fff700 1 -- 172.21.15.31:0/2796806200 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663000bee0 con 0x7f6638139510 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.492+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6630009530 con 0x7f6638139510 2024-04-26T07:30:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.493+0000 7f6627fff700 1 -- 172.21.15.31:0/2796806200 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f663000f070 con 0x7f6638139510 2024-04-26T07:30:08.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.493+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66380ac400 con 0x7f6638139510 2024-04-26T07:30:08.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.493+0000 7f6627fff700 1 -- 172.21.15.31:0/2796806200 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f663004b930 con 0x7f6638139510 2024-04-26T07:30:08.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.496+0000 7f6627fff700 1 -- 172.21.15.31:0/2796806200 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f66300080a0 con 0x7f6638139510 2024-04-26T07:30:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.610+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6638119fd0 con 0x7f6614038da0 2024-04-26T07:30:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.617+0000 7f6627fff700 1 -- 172.21.15.31:0/2796806200 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252030 (unknown 2965378022 0 3515930671) 0x7f662800b770 con 0x7f6614038da0 2024-04-26T07:30:08.620 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:30:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 >> v1:172.21.15.31:6816/39613 conn(0x7f6614038da0 legacy=0x7f661403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 msgr2=0x7f6638114fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 --2- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f6638114fd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f66300032f0 tx=0x7f6630016000).stop 2024-04-26T07:30:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 shutdown_connections 2024-04-26T07:30:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 --2- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66380a8af0 0x7f66380ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 --2- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6638139510 0x7f6638114fd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 --2- 172.21.15.31:0/2796806200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66380aca60 0x7f6638119920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 >> 172.21.15.31:0/2796806200 conn(0x7f6638066d50 msgr2=0x7f66380a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 shutdown_connections 2024-04-26T07:30:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:08.619+0000 7f663d8d5700 1 -- 172.21.15.31:0/2796806200 wait complete. 2024-04-26T07:30:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:30:08.630 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-04-26T07:30:07.996140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002548"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140126+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:32.140126+0000","last_peered":"2024-04-26T07:28:32.140126+0000","last_clean":"2024-04-26T07:28:32.140126+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:32.140126+0000","last_undegraded":"2024-04-26T07:28:32.140126+0000","last_fullsized":"2024-04-26T07:28:32.140126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140737+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:32.140737+0000","last_peered":"2024-04-26T07:28:32.140737+0000","last_clean":"2024-04-26T07:28:32.140737+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:32.140737+0000","last_undegraded":"2024-04-26T07:28:32.140737+0000","last_fullsized":"2024-04-26T07:28:32.140737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143288+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:32.143288+0000","last_peered":"2024-04-26T07:28:32.143288+0000","last_clean":"2024-04-26T07:28:32.143288+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:32.143288+0000","last_undegraded":"2024-04-26T07:28:32.143288+0000","last_fullsized":"2024-04-26T07:28:32.143288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143164+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:32.143164+0000","last_peered":"2024-04-26T07:28:32.143164+0000","last_clean":"2024-04-26T07:28:32.143164+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:32.143164+0000","last_undegraded":"2024-04-26T07:28:32.143164+0000","last_fullsized":"2024-04-26T07:28:32.143164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142620+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:32.142620+0000","last_peered":"2024-04-26T07:28:32.142620+0000","last_clean":"2024-04-26T07:28:32.142620+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:32.142620+0000","last_undegraded":"2024-04-26T07:28:32.142620+0000","last_fullsized":"2024-04-26T07:28:32.142620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137729+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:32.137729+0000","last_peered":"2024-04-26T07:28:32.137729+0000","last_clean":"2024-04-26T07:28:32.137729+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:32.137729+0000","last_undegraded":"2024-04-26T07:28:32.137729+0000","last_fullsized":"2024-04-26T07:28:32.137729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143368+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:32.143368+0000","last_peered":"2024-04-26T07:28:32.143368+0000","last_clean":"2024-04-26T07:28:32.143368+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:32.143368+0000","last_undegraded":"2024-04-26T07:28:32.143368+0000","last_fullsized":"2024-04-26T07:28:32.143368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138820+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:32.138820+0000","last_peered":"2024-04-26T07:28:32.138820+0000","last_clean":"2024-04-26T07:28:32.138820+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:32.138820+0000","last_undegraded":"2024-04-26T07:28:32.138820+0000","last_fullsized":"2024-04-26T07:28:32.138820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138789+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:32.138789+0000","last_peered":"2024-04-26T07:28:32.138789+0000","last_clean":"2024-04-26T07:28:32.138789+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:32.138789+0000","last_undegraded":"2024-04-26T07:28:32.138789+0000","last_fullsized":"2024-04-26T07:28:32.138789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140217+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:32.140217+0000","last_peered":"2024-04-26T07:28:32.140217+0000","last_clean":"2024-04-26T07:28:32.140217+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:32.140217+0000","last_undegraded":"2024-04-26T07:28:32.140217+0000","last_fullsized":"2024-04-26T07:28:32.140217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140887+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:32.140887+0000","last_peered":"2024-04-26T07:28:32.140887+0000","last_clean":"2024-04-26T07:28:32.140887+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:32.140887+0000","last_undegraded":"2024-04-26T07:28:32.140887+0000","last_fullsized":"2024-04-26T07:28:32.140887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138879+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:32.138879+0000","last_peered":"2024-04-26T07:28:32.138879+0000","last_clean":"2024-04-26T07:28:32.138879+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:32.138879+0000","last_undegraded":"2024-04-26T07:28:32.138879+0000","last_fullsized":"2024-04-26T07:28:32.138879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142710+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:32.142710+0000","last_peered":"2024-04-26T07:28:32.142710+0000","last_clean":"2024-04-26T07:28:32.142710+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:32.142710+0000","last_undegraded":"2024-04-26T07:28:32.142710+0000","last_fullsized":"2024-04-26T07:28:32.142710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143257+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:32.143257+0000","last_peered":"2024-04-26T07:28:32.143257+0000","last_clean":"2024-04-26T07:28:32.143257+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:32.143257+0000","last_undegraded":"2024-04-26T07:28:32.143257+0000","last_fullsized":"2024-04-26T07:28:32.143257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142802+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:32.142802+0000","last_peered":"2024-04-26T07:28:32.142802+0000","last_clean":"2024-04-26T07:28:32.142802+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:32.142802+0000","last_undegraded":"2024-04-26T07:28:32.142802+0000","last_fullsized":"2024-04-26T07:28:32.142802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139998+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:32.139998+0000","last_peered":"2024-04-26T07:28:32.139998+0000","last_clean":"2024-04-26T07:28:32.139998+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:32.139998+0000","last_undegraded":"2024-04-26T07:28:32.139998+0000","last_fullsized":"2024-04-26T07:28:32.139998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139079+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:32.139079+0000","last_peered":"2024-04-26T07:28:32.139079+0000","last_clean":"2024-04-26T07:28:32.139079+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:32.139079+0000","last_undegraded":"2024-04-26T07:28:32.139079+0000","last_fullsized":"2024-04-26T07:28:32.139079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138354+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.138354+0000","last_peered":"2024-04-26T07:28:32.138354+0000","last_clean":"2024-04-26T07:28:32.138354+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:32.138354+0000","last_undegraded":"2024-04-26T07:28:32.138354+0000","last_fullsized":"2024-04-26T07:28:32.138354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142486+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:32.142486+0000","last_peered":"2024-04-26T07:28:32.142486+0000","last_clean":"2024-04-26T07:28:32.142486+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:32.142486+0000","last_undegraded":"2024-04-26T07:28:32.142486+0000","last_fullsized":"2024-04-26T07:28:32.142486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137844+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:32.137844+0000","last_peered":"2024-04-26T07:28:32.137844+0000","last_clean":"2024-04-26T07:28:32.137844+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:32.137844+0000","last_undegraded":"2024-04-26T07:28:32.137844+0000","last_fullsized":"2024-04-26T07:28:32.137844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140794+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.140794+0000","last_peered":"2024-04-26T07:28:32.140794+0000","last_clean":"2024-04-26T07:28:32.140794+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:32.140794+0000","last_undegraded":"2024-04-26T07:28:32.140794+0000","last_fullsized":"2024-04-26T07:28:32.140794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138683+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:32.138683+0000","last_peered":"2024-04-26T07:28:32.138683+0000","last_clean":"2024-04-26T07:28:32.138683+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:32.138683+0000","last_undegraded":"2024-04-26T07:28:32.138683+0000","last_fullsized":"2024-04-26T07:28:32.138683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137704+0000","last_change":"2024-04-26T07:28:30.838970+0000","last_active":"2024-04-26T07:28:32.137704+0000","last_peered":"2024-04-26T07:28:32.137704+0000","last_clean":"2024-04-26T07:28:32.137704+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:28:32.137704+0000","last_undegraded":"2024-04-26T07:28:32.137704+0000","last_fullsized":"2024-04-26T07:28:32.137704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138132+0000","last_change":"2024-04-26T07:28:30.845233+0000","last_active":"2024-04-26T07:28:32.138132+0000","last_peered":"2024-04-26T07:28:32.138132+0000","last_clean":"2024-04-26T07:28:32.138132+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:28:32.138132+0000","last_undegraded":"2024-04-26T07:28:32.138132+0000","last_fullsized":"2024-04-26T07:28:32.138132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142948+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:32.142948+0000","last_peered":"2024-04-26T07:28:32.142948+0000","last_clean":"2024-04-26T07:28:32.142948+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:32.142948+0000","last_undegraded":"2024-04-26T07:28:32.142948+0000","last_fullsized":"2024-04-26T07:28:32.142948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847320+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:33.847320+0000","last_peered":"2024-04-26T07:28:33.847320+0000","last_clean":"2024-04-26T07:28:33.847320+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:33.847320+0000","last_undegraded":"2024-04-26T07:28:33.847320+0000","last_fullsized":"2024-04-26T07:28:33.847320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'7","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:12.136901+0000","last_change":"2024-04-26T07:28:30.850023+0000","last_active":"2024-04-26T07:29:12.136901+0000","last_peered":"2024-04-26T07:29:12.136901+0000","last_clean":"2024-04-26T07:29:12.136901+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:29:12.136901+0000","last_undegraded":"2024-04-26T07:29:12.136901+0000","last_fullsized":"2024-04-26T07:29:12.136901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137664+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:32.137664+0000","last_peered":"2024-04-26T07:28:32.137664+0000","last_clean":"2024-04-26T07:28:32.137664+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:32.137664+0000","last_undegraded":"2024-04-26T07:28:32.137664+0000","last_fullsized":"2024-04-26T07:28:32.137664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848610+0000","last_change":"2024-04-26T07:28:30.853633+0000","last_active":"2024-04-26T07:28:33.848610+0000","last_peered":"2024-04-26T07:28:33.848610+0000","last_clean":"2024-04-26T07:28:33.848610+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:28:33.848610+0000","last_undegraded":"2024-04-26T07:28:33.848610+0000","last_fullsized":"2024-04-26T07:28:33.848610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138363+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:32.138363+0000","last_peered":"2024-04-26T07:28:32.138363+0000","last_clean":"2024-04-26T07:28:32.138363+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:32.138363+0000","last_undegraded":"2024-04-26T07:28:32.138363+0000","last_fullsized":"2024-04-26T07:28:32.138363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848435+0000","last_change":"2024-04-26T07:28:30.849815+0000","last_active":"2024-04-26T07:28:33.848435+0000","last_peered":"2024-04-26T07:28:33.848435+0000","last_clean":"2024-04-26T07:28:33.848435+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:28:33.848435+0000","last_undegraded":"2024-04-26T07:28:33.848435+0000","last_fullsized":"2024-04-26T07:28:33.848435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138036+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:32.138036+0000","last_peered":"2024-04-26T07:28:32.138036+0000","last_clean":"2024-04-26T07:28:32.138036+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:32.138036+0000","last_undegraded":"2024-04-26T07:28:32.138036+0000","last_fullsized":"2024-04-26T07:28:32.138036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'16","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:48.306404+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:29:48.306404+0000","last_peered":"2024-04-26T07:29:48.306404+0000","last_clean":"2024-04-26T07:29:48.306404+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:29:48.306404+0000","last_undegraded":"2024-04-26T07:29:48.306404+0000","last_fullsized":"2024-04-26T07:29:48.306404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140996+0000","last_change":"2024-04-26T07:28:31.165872+0000","last_active":"2024-04-26T07:28:32.140996+0000","last_peered":"2024-04-26T07:28:32.140996+0000","last_clean":"2024-04-26T07:28:32.140996+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:28:32.140996+0000","last_undegraded":"2024-04-26T07:28:32.140996+0000","last_fullsized":"2024-04-26T07:28:32.140996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849427+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:33.849427+0000","last_peered":"2024-04-26T07:28:33.849427+0000","last_clean":"2024-04-26T07:28:33.849427+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:33.849427+0000","last_undegraded":"2024-04-26T07:28:33.849427+0000","last_fullsized":"2024-04-26T07:28:33.849427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137836+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:32.137836+0000","last_peered":"2024-04-26T07:28:32.137836+0000","last_clean":"2024-04-26T07:28:32.137836+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:32.137836+0000","last_undegraded":"2024-04-26T07:28:32.137836+0000","last_fullsized":"2024-04-26T07:28:32.137836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848622+0000","last_change":"2024-04-26T07:28:30.847060+0000","last_active":"2024-04-26T07:28:33.848622+0000","last_peered":"2024-04-26T07:28:33.848622+0000","last_clean":"2024-04-26T07:28:33.848622+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:28:33.848622+0000","last_undegraded":"2024-04-26T07:28:33.848622+0000","last_fullsized":"2024-04-26T07:28:33.848622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139915+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:32.139915+0000","last_peered":"2024-04-26T07:28:32.139915+0000","last_clean":"2024-04-26T07:28:32.139915+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:32.139915+0000","last_undegraded":"2024-04-26T07:28:32.139915+0000","last_fullsized":"2024-04-26T07:28:32.139915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138176+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:32.138176+0000","last_peered":"2024-04-26T07:28:32.138176+0000","last_clean":"2024-04-26T07:28:32.138176+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:32.138176+0000","last_undegraded":"2024-04-26T07:28:32.138176+0000","last_fullsized":"2024-04-26T07:28:32.138176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143072+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:32.143072+0000","last_peered":"2024-04-26T07:28:32.143072+0000","last_clean":"2024-04-26T07:28:32.143072+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:32.143072+0000","last_undegraded":"2024-04-26T07:28:32.143072+0000","last_fullsized":"2024-04-26T07:28:32.143072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847755+0000","last_change":"2024-04-26T07:28:30.839424+0000","last_active":"2024-04-26T07:28:33.847755+0000","last_peered":"2024-04-26T07:28:33.847755+0000","last_clean":"2024-04-26T07:28:33.847755+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:28:33.847755+0000","last_undegraded":"2024-04-26T07:28:33.847755+0000","last_fullsized":"2024-04-26T07:28:33.847755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139763+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:32.139763+0000","last_peered":"2024-04-26T07:28:32.139763+0000","last_clean":"2024-04-26T07:28:32.139763+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:32.139763+0000","last_undegraded":"2024-04-26T07:28:32.139763+0000","last_fullsized":"2024-04-26T07:28:32.139763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142966+0000","last_change":"2024-04-26T07:28:30.849542+0000","last_active":"2024-04-26T07:28:32.142966+0000","last_peered":"2024-04-26T07:28:32.142966+0000","last_clean":"2024-04-26T07:28:32.142966+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:28:32.142966+0000","last_undegraded":"2024-04-26T07:28:32.142966+0000","last_fullsized":"2024-04-26T07:28:32.142966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137801+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:32.137801+0000","last_peered":"2024-04-26T07:28:32.137801+0000","last_clean":"2024-04-26T07:28:32.137801+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:32.137801+0000","last_undegraded":"2024-04-26T07:28:32.137801+0000","last_fullsized":"2024-04-26T07:28:32.137801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140598+0000","last_change":"2024-04-26T07:28:30.853399+0000","last_active":"2024-04-26T07:28:32.140598+0000","last_peered":"2024-04-26T07:28:32.140598+0000","last_clean":"2024-04-26T07:28:32.140598+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:28:32.140598+0000","last_undegraded":"2024-04-26T07:28:32.140598+0000","last_fullsized":"2024-04-26T07:28:32.140598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138273+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:32.138273+0000","last_peered":"2024-04-26T07:28:32.138273+0000","last_clean":"2024-04-26T07:28:32.138273+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:32.138273+0000","last_undegraded":"2024-04-26T07:28:32.138273+0000","last_fullsized":"2024-04-26T07:28:32.138273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140135+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:32.140135+0000","last_peered":"2024-04-26T07:28:32.140135+0000","last_clean":"2024-04-26T07:28:32.140135+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:32.140135+0000","last_undegraded":"2024-04-26T07:28:32.140135+0000","last_fullsized":"2024-04-26T07:28:32.140135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139559+0000","last_change":"2024-04-26T07:28:31.165065+0000","last_active":"2024-04-26T07:28:32.139559+0000","last_peered":"2024-04-26T07:28:32.139559+0000","last_clean":"2024-04-26T07:28:32.139559+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:28:32.139559+0000","last_undegraded":"2024-04-26T07:28:32.139559+0000","last_fullsized":"2024-04-26T07:28:32.139559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143103+0000","last_change":"2024-04-26T07:28:30.844998+0000","last_active":"2024-04-26T07:28:32.143103+0000","last_peered":"2024-04-26T07:28:32.143103+0000","last_clean":"2024-04-26T07:28:32.143103+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:28:32.143103+0000","last_undegraded":"2024-04-26T07:28:32.143103+0000","last_fullsized":"2024-04-26T07:28:32.143103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142942+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:32.142942+0000","last_peered":"2024-04-26T07:28:32.142942+0000","last_clean":"2024-04-26T07:28:32.142942+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:32.142942+0000","last_undegraded":"2024-04-26T07:28:32.142942+0000","last_fullsized":"2024-04-26T07:28:32.142942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849085+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:33.849085+0000","last_peered":"2024-04-26T07:28:33.849085+0000","last_clean":"2024-04-26T07:28:33.849085+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:33.849085+0000","last_undegraded":"2024-04-26T07:28:33.849085+0000","last_fullsized":"2024-04-26T07:28:33.849085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142971+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:32.142971+0000","last_peered":"2024-04-26T07:28:32.142971+0000","last_clean":"2024-04-26T07:28:32.142971+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:32.142971+0000","last_undegraded":"2024-04-26T07:28:32.142971+0000","last_fullsized":"2024-04-26T07:28:32.142971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.136266+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:57.136266+0000","last_peered":"2024-04-26T07:28:57.136266+0000","last_clean":"2024-04-26T07:28:57.136266+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:57.136266+0000","last_undegraded":"2024-04-26T07:28:57.136266+0000","last_fullsized":"2024-04-26T07:28:57.136266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140027+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:32.140027+0000","last_peered":"2024-04-26T07:28:32.140027+0000","last_clean":"2024-04-26T07:28:32.140027+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:32.140027+0000","last_undegraded":"2024-04-26T07:28:32.140027+0000","last_fullsized":"2024-04-26T07:28:32.140027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848748+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:33.848748+0000","last_peered":"2024-04-26T07:28:33.848748+0000","last_clean":"2024-04-26T07:28:33.848748+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:33.848748+0000","last_undegraded":"2024-04-26T07:28:33.848748+0000","last_fullsized":"2024-04-26T07:28:33.848748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140673+0000","last_change":"2024-04-26T07:28:31.164112+0000","last_active":"2024-04-26T07:28:32.140673+0000","last_peered":"2024-04-26T07:28:32.140673+0000","last_clean":"2024-04-26T07:28:32.140673+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:28:32.140673+0000","last_undegraded":"2024-04-26T07:28:32.140673+0000","last_fullsized":"2024-04-26T07:28:32.140673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849508+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:33.849508+0000","last_peered":"2024-04-26T07:28:33.849508+0000","last_clean":"2024-04-26T07:28:33.849508+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:33.849508+0000","last_undegraded":"2024-04-26T07:28:33.849508+0000","last_fullsized":"2024-04-26T07:28:33.849508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140916+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:32.140916+0000","last_peered":"2024-04-26T07:28:32.140916+0000","last_clean":"2024-04-26T07:28:32.140916+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:32.140916+0000","last_undegraded":"2024-04-26T07:28:32.140916+0000","last_fullsized":"2024-04-26T07:28:32.140916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138969+0000","last_change":"2024-04-26T07:28:22.650334+0000","last_active":"2024-04-26T07:28:32.138969+0000","last_peered":"2024-04-26T07:28:32.138969+0000","last_clean":"2024-04-26T07:28:32.138969+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:28:32.138969+0000","last_undegraded":"2024-04-26T07:28:32.138969+0000","last_fullsized":"2024-04-26T07:28:32.138969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848587+0000","last_change":"2024-04-26T07:28:30.851175+0000","last_active":"2024-04-26T07:28:33.848587+0000","last_peered":"2024-04-26T07:28:33.848587+0000","last_clean":"2024-04-26T07:28:33.848587+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:28:33.848587+0000","last_undegraded":"2024-04-26T07:28:33.848587+0000","last_fullsized":"2024-04-26T07:28:33.848587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137905+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.137905+0000","last_peered":"2024-04-26T07:28:32.137905+0000","last_clean":"2024-04-26T07:28:32.137905+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:32.137905+0000","last_undegraded":"2024-04-26T07:28:32.137905+0000","last_fullsized":"2024-04-26T07:28:32.137905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139162+0000","last_change":"2024-04-26T07:28:22.023450+0000","last_active":"2024-04-26T07:28:32.139162+0000","last_peered":"2024-04-26T07:28:32.139162+0000","last_clean":"2024-04-26T07:28:32.139162+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:28:32.139162+0000","last_undegraded":"2024-04-26T07:28:32.139162+0000","last_fullsized":"2024-04-26T07:28:32.139162+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:46.777814+0000","last_change":"2024-04-26T07:28:30.853616+0000","last_active":"2024-04-26T07:28:46.777814+0000","last_peered":"2024-04-26T07:28:46.777814+0000","last_clean":"2024-04-26T07:28:46.777814+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:28:46.777814+0000","last_undegraded":"2024-04-26T07:28:46.777814+0000","last_fullsized":"2024-04-26T07:28:46.777814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139154+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:32.139154+0000","last_peered":"2024-04-26T07:28:32.139154+0000","last_clean":"2024-04-26T07:28:32.139154+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:32.139154+0000","last_undegraded":"2024-04-26T07:28:32.139154+0000","last_fullsized":"2024-04-26T07:28:32.139154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139749+0000","last_change":"2024-04-26T07:28:22.024031+0000","last_active":"2024-04-26T07:28:32.139749+0000","last_peered":"2024-04-26T07:28:32.139749+0000","last_clean":"2024-04-26T07:28:32.139749+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:28:32.139749+0000","last_undegraded":"2024-04-26T07:28:32.139749+0000","last_fullsized":"2024-04-26T07:28:32.139749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.846746+0000","last_change":"2024-04-26T07:28:30.839738+0000","last_active":"2024-04-26T07:28:33.846746+0000","last_peered":"2024-04-26T07:28:33.846746+0000","last_clean":"2024-04-26T07:28:33.846746+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:28:33.846746+0000","last_undegraded":"2024-04-26T07:28:33.846746+0000","last_fullsized":"2024-04-26T07:28:33.846746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140827+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:32.140827+0000","last_peered":"2024-04-26T07:28:32.140827+0000","last_clean":"2024-04-26T07:28:32.140827+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:32.140827+0000","last_undegraded":"2024-04-26T07:28:32.140827+0000","last_fullsized":"2024-04-26T07:28:32.140827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137628+0000","last_change":"2024-04-26T07:28:22.023795+0000","last_active":"2024-04-26T07:28:32.137628+0000","last_peered":"2024-04-26T07:28:32.137628+0000","last_clean":"2024-04-26T07:28:32.137628+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:28:32.137628+0000","last_undegraded":"2024-04-26T07:28:32.137628+0000","last_fullsized":"2024-04-26T07:28:32.137628+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137893+0000","last_change":"2024-04-26T07:28:18.549478+0000","last_active":"2024-04-26T07:28:32.137893+0000","last_peered":"2024-04-26T07:28:32.137893+0000","last_clean":"2024-04-26T07:28:32.137893+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:28:32.137893+0000","last_undegraded":"2024-04-26T07:28:32.137893+0000","last_fullsized":"2024-04-26T07:28:32.137893+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:14.971410+0000","last_clean_scrub_stamp":"2024-04-26T07:28:14.971410+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138992+0000","last_change":"2024-04-26T07:28:30.859261+0000","last_active":"2024-04-26T07:28:32.138992+0000","last_peered":"2024-04-26T07:28:32.138992+0000","last_clean":"2024-04-26T07:28:32.138992+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:28:32.138992+0000","last_undegraded":"2024-04-26T07:28:32.138992+0000","last_fullsized":"2024-04-26T07:28:32.138992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140556+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:32.140556+0000","last_peered":"2024-04-26T07:28:32.140556+0000","last_clean":"2024-04-26T07:28:32.140556+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:32.140556+0000","last_undegraded":"2024-04-26T07:28:32.140556+0000","last_fullsized":"2024-04-26T07:28:32.140556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137311+0000","last_change":"2024-04-26T07:28:22.026306+0000","last_active":"2024-04-26T07:28:32.137311+0000","last_peered":"2024-04-26T07:28:32.137311+0000","last_clean":"2024-04-26T07:28:32.137311+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:28:32.137311+0000","last_undegraded":"2024-04-26T07:28:32.137311+0000","last_fullsized":"2024-04-26T07:28:32.137311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847145+0000","last_change":"2024-04-26T07:28:30.854930+0000","last_active":"2024-04-26T07:28:33.847145+0000","last_peered":"2024-04-26T07:28:33.847145+0000","last_clean":"2024-04-26T07:28:33.847145+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:28:33.847145+0000","last_undegraded":"2024-04-26T07:28:33.847145+0000","last_fullsized":"2024-04-26T07:28:33.847145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143152+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:32.143152+0000","last_peered":"2024-04-26T07:28:32.143152+0000","last_clean":"2024-04-26T07:28:32.143152+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:32.143152+0000","last_undegraded":"2024-04-26T07:28:32.143152+0000","last_fullsized":"2024-04-26T07:28:32.143152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140322+0000","last_change":"2024-04-26T07:28:22.650352+0000","last_active":"2024-04-26T07:28:32.140322+0000","last_peered":"2024-04-26T07:28:32.140322+0000","last_clean":"2024-04-26T07:28:32.140322+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:28:32.140322+0000","last_undegraded":"2024-04-26T07:28:32.140322+0000","last_fullsized":"2024-04-26T07:28:32.140322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138450+0000","last_change":"2024-04-26T07:28:30.844050+0000","last_active":"2024-04-26T07:28:32.138450+0000","last_peered":"2024-04-26T07:28:32.138450+0000","last_clean":"2024-04-26T07:28:32.138450+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:28:32.138450+0000","last_undegraded":"2024-04-26T07:28:32.138450+0000","last_fullsized":"2024-04-26T07:28:32.138450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142850+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:32.142850+0000","last_peered":"2024-04-26T07:28:32.142850+0000","last_clean":"2024-04-26T07:28:32.142850+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:32.142850+0000","last_undegraded":"2024-04-26T07:28:32.142850+0000","last_fullsized":"2024-04-26T07:28:32.142850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848248+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:33.848248+0000","last_peered":"2024-04-26T07:28:33.848248+0000","last_clean":"2024-04-26T07:28:33.848248+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:33.848248+0000","last_undegraded":"2024-04-26T07:28:33.848248+0000","last_fullsized":"2024-04-26T07:28:33.848248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138741+0000","last_change":"2024-04-26T07:28:22.650310+0000","last_active":"2024-04-26T07:28:32.138741+0000","last_peered":"2024-04-26T07:28:32.138741+0000","last_clean":"2024-04-26T07:28:32.138741+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:28:32.138741+0000","last_undegraded":"2024-04-26T07:28:32.138741+0000","last_fullsized":"2024-04-26T07:28:32.138741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137320+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:32.137320+0000","last_peered":"2024-04-26T07:28:32.137320+0000","last_clean":"2024-04-26T07:28:32.137320+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:32.137320+0000","last_undegraded":"2024-04-26T07:28:32.137320+0000","last_fullsized":"2024-04-26T07:28:32.137320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139639+0000","last_change":"2024-04-26T07:28:22.650378+0000","last_active":"2024-04-26T07:28:32.139639+0000","last_peered":"2024-04-26T07:28:32.139639+0000","last_clean":"2024-04-26T07:28:32.139639+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:28:32.139639+0000","last_undegraded":"2024-04-26T07:28:32.139639+0000","last_fullsized":"2024-04-26T07:28:32.139639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:21.009687+0000","last_clean_scrub_stamp":"2024-04-26T07:28:21.009687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:52.140606+0000","last_change":"2024-04-26T07:28:30.848849+0000","last_active":"2024-04-26T07:28:52.140606+0000","last_peered":"2024-04-26T07:28:52.140606+0000","last_clean":"2024-04-26T07:28:52.140606+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:28:52.140606+0000","last_undegraded":"2024-04-26T07:28:52.140606+0000","last_fullsized":"2024-04-26T07:28:52.140606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139591+0000","last_change":"2024-04-26T07:28:31.160967+0000","last_active":"2024-04-26T07:28:32.139591+0000","last_peered":"2024-04-26T07:28:32.139591+0000","last_clean":"2024-04-26T07:28:32.139591+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:28:32.139591+0000","last_undegraded":"2024-04-26T07:28:32.139591+0000","last_fullsized":"2024-04-26T07:28:32.139591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'10","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.139239+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:57.139239+0000","last_peered":"2024-04-26T07:28:57.139239+0000","last_clean":"2024-04-26T07:28:57.139239+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:57.139239+0000","last_undegraded":"2024-04-26T07:28:57.139239+0000","last_fullsized":"2024-04-26T07:28:57.139239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140278+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:32.140278+0000","last_peered":"2024-04-26T07:28:32.140278+0000","last_clean":"2024-04-26T07:28:32.140278+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:32.140278+0000","last_undegraded":"2024-04-26T07:28:32.140278+0000","last_fullsized":"2024-04-26T07:28:32.140278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138737+0000","last_change":"2024-04-26T07:28:30.852699+0000","last_active":"2024-04-26T07:28:32.138737+0000","last_peered":"2024-04-26T07:28:32.138737+0000","last_clean":"2024-04-26T07:28:32.138737+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:28:32.138737+0000","last_undegraded":"2024-04-26T07:28:32.138737+0000","last_fullsized":"2024-04-26T07:28:32.138737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140941+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:32.140941+0000","last_peered":"2024-04-26T07:28:32.140941+0000","last_clean":"2024-04-26T07:28:32.140941+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:32.140941+0000","last_undegraded":"2024-04-26T07:28:32.140941+0000","last_fullsized":"2024-04-26T07:28:32.140941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140429+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:32.140429+0000","last_peered":"2024-04-26T07:28:32.140429+0000","last_clean":"2024-04-26T07:28:32.140429+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:32.140429+0000","last_undegraded":"2024-04-26T07:28:32.140429+0000","last_fullsized":"2024-04-26T07:28:32.140429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139495+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:32.139495+0000","last_peered":"2024-04-26T07:28:32.139495+0000","last_clean":"2024-04-26T07:28:32.139495+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:32.139495+0000","last_undegraded":"2024-04-26T07:28:32.139495+0000","last_fullsized":"2024-04-26T07:28:32.139495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138254+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:32.138254+0000","last_peered":"2024-04-26T07:28:32.138254+0000","last_clean":"2024-04-26T07:28:32.138254+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:32.138254+0000","last_undegraded":"2024-04-26T07:28:32.138254+0000","last_fullsized":"2024-04-26T07:28:32.138254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143222+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:32.143222+0000","last_peered":"2024-04-26T07:28:32.143222+0000","last_clean":"2024-04-26T07:28:32.143222+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:32.143222+0000","last_undegraded":"2024-04-26T07:28:32.143222+0000","last_fullsized":"2024-04-26T07:28:32.143222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139300+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:32.139300+0000","last_peered":"2024-04-26T07:28:32.139300+0000","last_clean":"2024-04-26T07:28:32.139300+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:32.139300+0000","last_undegraded":"2024-04-26T07:28:32.139300+0000","last_fullsized":"2024-04-26T07:28:32.139300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138401+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:32.138401+0000","last_peered":"2024-04-26T07:28:32.138401+0000","last_clean":"2024-04-26T07:28:32.138401+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:32.138401+0000","last_undegraded":"2024-04-26T07:28:32.138401+0000","last_fullsized":"2024-04-26T07:28:32.138401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143246+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:32.143246+0000","last_peered":"2024-04-26T07:28:32.143246+0000","last_clean":"2024-04-26T07:28:32.143246+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:32.143246+0000","last_undegraded":"2024-04-26T07:28:32.143246+0000","last_fullsized":"2024-04-26T07:28:32.143246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138871+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:32.138871+0000","last_peered":"2024-04-26T07:28:32.138871+0000","last_clean":"2024-04-26T07:28:32.138871+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:32.138871+0000","last_undegraded":"2024-04-26T07:28:32.138871+0000","last_fullsized":"2024-04-26T07:28:32.138871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705687,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.46899999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705689,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.251},{"interface":"front","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Apr 26 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.32400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"last":0.255},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.21199999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.247},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"last":0.224},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.23599999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705688,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.27100000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Apr 26 07:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.24199999999999999}]}]}]}} 2024-04-26T07:30:08.636 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.637 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.637 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.637 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.637 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.637 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.637 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.637 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.638 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.638 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.638 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.638 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.638 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.638 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.639 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.639 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.639 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.639 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.639 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.639 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.640 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.640 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.640 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.640 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.640 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.640 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.640 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.641 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.641 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.641 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.641 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.641 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.641 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.642 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.642 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.642 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.642 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.642 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.642 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.643 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.643 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.643 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.643 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.643 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.643 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.643 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.644 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.644 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.644 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.644 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.644 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.644 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.645 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.645 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.645 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.645 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.645 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.645 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.646 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.646 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.646 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.646 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.646 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.646 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.647 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.647 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T07:28:21.009687+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.647 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.647 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.647 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T07:28:21.009687+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.647 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.648 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.648 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T07:28:21.009687+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.648 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.648 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.648 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T07:28:21.009687+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.648 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T07:28:14.971410+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.649 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.649 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.649 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T07:28:21.009687+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.649 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.649 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.649 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T07:28:21.009687+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.650 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.650 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.650 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.650 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T07:28:21.009687+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.650 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.650 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T07:28:21.009687+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=21, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.650 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.651 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.651 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.651 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.651 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.651 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.651 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.652 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.652 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.652 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.652 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.652 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.652 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.652 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.653 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.653 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.653 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:08.653 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:30:28.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:30:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.773+0000 7f8ba1995700 1 Processor -- start 2024-04-26T07:30:28.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.773+0000 7f8ba1995700 1 -- start start 2024-04-26T07:30:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8ba1995700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8b9c067500 0x7f8b9c09a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8ba1995700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c09c0a0 0x7f8b9c136d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8ba1995700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c09b670 con 0x7f8b9c09bc70 2024-04-26T07:30:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8ba1995700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c1361b0 con 0x7f8b9c067500 2024-04-26T07:30:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8ba1995700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c09b400 con 0x7f8b9c09c0a0 2024-04-26T07:30:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8b9affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8b9c067500 0x7f8b9c09a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8b9b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c09c0a0 0x7f8b9c136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8b9a7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8b9c09bc70 0x7f8b9c136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40572/0 (socket says 172.21.15.31:40572) 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.774+0000 7f8b9a7fc700 1 -- 172.21.15.31:0/3890300600 learned_addr learned my addr 172.21.15.31:0/3890300600 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b9b7fe700 1 -- 172.21.15.31:0/3890300600 >> v2:172.21.15.31:3300/0 conn(0x7f8b9c067500 msgr2=0x7f8b9c09a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b9b7fe700 1 --2- 172.21.15.31:0/3890300600 >> v2:172.21.15.31:3300/0 conn(0x7f8b9c067500 0x7f8b9c09a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b9b7fe700 1 -- 172.21.15.31:0/3890300600 >> v1:172.21.15.31:6789/0 conn(0x7f8b9c09bc70 legacy=0x7f8b9c136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b9b7fe700 1 -- 172.21.15.31:0/3890300600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c1363a0 con 0x7f8b9c09c0a0 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b99ffb700 1 -- 172.21.15.31:0/3890300600 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207746443 0 0) 0x7f8b9c09b670 con 0x7f8b9c09bc70 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b9affd700 1 --2- 172.21.15.31:0/3890300600 >> v2:172.21.15.31:3300/0 conn(0x7f8b9c067500 0x7f8b9c09a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:28.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b9b7fe700 1 --2- 172.21.15.31:0/3890300600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c09c0a0 0x7f8b9c136d70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f8b940032f0 tx=0x7f8b940091d0).ready entity=mon.1 client_cookie=6f700436888e6cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b99ffb700 1 -- 172.21.15.31:0/3890300600 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b9400b6c0 con 0x7f8b9c09c0a0 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b99ffb700 1 -- 172.21.15.31:0/3890300600 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9400b820 con 0x7f8b9c09c0a0 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.775+0000 7f8b99ffb700 1 -- 172.21.15.31:0/3890300600 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b9400b990 con 0x7f8b9c09c0a0 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.776+0000 7f8ba1995700 1 -- 172.21.15.31:0/3890300600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c09c0a0 msgr2=0x7f8b9c136d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.776+0000 7f8ba1995700 1 --2- 172.21.15.31:0/3890300600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c09c0a0 0x7f8b9c136d70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f8b940032f0 tx=0x7f8b940091d0).stop 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.776+0000 7f8ba1995700 1 -- 172.21.15.31:0/3890300600 shutdown_connections 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.776+0000 7f8ba1995700 1 --2- 172.21.15.31:0/3890300600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c09c0a0 0x7f8b9c136d70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.776+0000 7f8ba1995700 1 --2- 172.21.15.31:0/3890300600 >> v2:172.21.15.31:3300/0 conn(0x7f8b9c067500 0x7f8b9c09a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.776+0000 7f8ba1995700 1 -- 172.21.15.31:0/3890300600 >> 172.21.15.31:0/3890300600 conn(0x7f8b9c05cfb0 msgr2=0x7f8b9c062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.776+0000 7f8ba1995700 1 -- 172.21.15.31:0/3890300600 shutdown_connections 2024-04-26T07:30:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.776+0000 7f8ba1995700 1 -- 172.21.15.31:0/3890300600 wait complete. 2024-04-26T07:30:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8ba1995700 1 Processor -- start 2024-04-26T07:30:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8ba1995700 1 -- start start 2024-04-26T07:30:28.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8ba1995700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c067500 0x7f8b9c134450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:28.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8ba1995700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b9c09bc70 0x7f8b9c094ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:28.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8ba1995700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b9c09c0a0 0x7f8b9c1459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:28.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8ba1995700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c094620 con 0x7f8b9c09bc70 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8ba1995700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c145730 con 0x7f8b9c067500 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8ba1995700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c134e30 con 0x7f8b9c09c0a0 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8b9affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c067500 0x7f8b9c134450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8b9affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c067500 0x7f8b9c134450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34696/0 (socket says 172.21.15.31:34696) 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8b9affd700 1 -- 172.21.15.31:0/3838241424 learned_addr learned my addr 172.21.15.31:0/3838241424 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8b9b7fe700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b9c09c0a0 0x7f8b9c1459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.777+0000 7f8b9a7fc700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b9c09bc70 0x7f8b9c094ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b9affd700 1 -- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b9c09c0a0 msgr2=0x7f8b9c1459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b9affd700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b9c09c0a0 0x7f8b9c1459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:28.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b9affd700 1 -- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b9c09bc70 msgr2=0x7f8b9c094ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b9affd700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b9c09bc70 0x7f8b9c094ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b9affd700 1 -- 172.21.15.31:0/3838241424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c00b180 con 0x7f8b9c067500 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b9affd700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c067500 0x7f8b9c134450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8b8c00c000 tx=0x7f8b8c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b8bfff700 1 -- 172.21.15.31:0/3838241424 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b8c00c7e0 con 0x7f8b9c067500 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b8bfff700 1 -- 172.21.15.31:0/3838241424 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00c940 con 0x7f8b9c067500 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b94009470 con 0x7f8b9c067500 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8b8bfff700 1 -- 172.21.15.31:0/3838241424 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b8c00cca0 con 0x7f8b9c067500 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.778+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c094fa0 con 0x7f8b9c067500 2024-04-26T07:30:28.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.779+0000 7f8b8bfff700 1 -- 172.21.15.31:0/3838241424 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8b8c01c460 con 0x7f8b9c067500 2024-04-26T07:30:28.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.779+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c067960 con 0x7f8b9c067500 2024-04-26T07:30:28.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.779+0000 7f8b8bfff700 1 -- 172.21.15.31:0/3838241424 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8b8c04ada0 con 0x7f8b9c067500 2024-04-26T07:30:28.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.782+0000 7f8b8bfff700 1 -- 172.21.15.31:0/3838241424 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8b8c0336d0 con 0x7f8b9c067500 2024-04-26T07:30:28.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.896+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b9c06bbc0 con 0x7f8b78038dd0 2024-04-26T07:30:28.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.902+0000 7f8b8bfff700 1 -- 172.21.15.31:0/3838241424 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252145 (unknown 2965378022 0 2919155705) 0x7f8b9c06bbc0 con 0x7f8b78038dd0 2024-04-26T07:30:28.907 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:30:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 >> v1:172.21.15.31:6816/39613 conn(0x7f8b78038dd0 legacy=0x7f8b7803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c067500 msgr2=0x7f8b9c134450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c067500 0x7f8b9c134450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8b8c00c000 tx=0x7f8b8c006df0).stop 2024-04-26T07:30:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 shutdown_connections 2024-04-26T07:30:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b9c09c0a0 0x7f8b9c1459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b9c067500 0x7f8b9c134450 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 --2- 172.21.15.31:0/3838241424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b9c09bc70 0x7f8b9c094ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 >> 172.21.15.31:0/3838241424 conn(0x7f8b9c05cfb0 msgr2=0x7f8b9c13b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:28.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 shutdown_connections 2024-04-26T07:30:28.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:28.905+0000 7f8ba1995700 1 -- 172.21.15.31:0/3838241424 wait complete. 2024-04-26T07:30:28.910 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:30:28.916 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-26T07:30:28.001100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8826,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002870"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140126+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:32.140126+0000","last_peered":"2024-04-26T07:28:32.140126+0000","last_clean":"2024-04-26T07:28:32.140126+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:32.140126+0000","last_undegraded":"2024-04-26T07:28:32.140126+0000","last_fullsized":"2024-04-26T07:28:32.140126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140737+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:32.140737+0000","last_peered":"2024-04-26T07:28:32.140737+0000","last_clean":"2024-04-26T07:28:32.140737+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:32.140737+0000","last_undegraded":"2024-04-26T07:28:32.140737+0000","last_fullsized":"2024-04-26T07:28:32.140737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143288+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:32.143288+0000","last_peered":"2024-04-26T07:28:32.143288+0000","last_clean":"2024-04-26T07:28:32.143288+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:32.143288+0000","last_undegraded":"2024-04-26T07:28:32.143288+0000","last_fullsized":"2024-04-26T07:28:32.143288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143164+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:32.143164+0000","last_peered":"2024-04-26T07:28:32.143164+0000","last_clean":"2024-04-26T07:28:32.143164+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:32.143164+0000","last_undegraded":"2024-04-26T07:28:32.143164+0000","last_fullsized":"2024-04-26T07:28:32.143164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142620+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:32.142620+0000","last_peered":"2024-04-26T07:28:32.142620+0000","last_clean":"2024-04-26T07:28:32.142620+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:32.142620+0000","last_undegraded":"2024-04-26T07:28:32.142620+0000","last_fullsized":"2024-04-26T07:28:32.142620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137729+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:32.137729+0000","last_peered":"2024-04-26T07:28:32.137729+0000","last_clean":"2024-04-26T07:28:32.137729+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:32.137729+0000","last_undegraded":"2024-04-26T07:28:32.137729+0000","last_fullsized":"2024-04-26T07:28:32.137729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143368+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:32.143368+0000","last_peered":"2024-04-26T07:28:32.143368+0000","last_clean":"2024-04-26T07:28:32.143368+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:32.143368+0000","last_undegraded":"2024-04-26T07:28:32.143368+0000","last_fullsized":"2024-04-26T07:28:32.143368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138820+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:32.138820+0000","last_peered":"2024-04-26T07:28:32.138820+0000","last_clean":"2024-04-26T07:28:32.138820+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:32.138820+0000","last_undegraded":"2024-04-26T07:28:32.138820+0000","last_fullsized":"2024-04-26T07:28:32.138820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138789+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:32.138789+0000","last_peered":"2024-04-26T07:28:32.138789+0000","last_clean":"2024-04-26T07:28:32.138789+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:32.138789+0000","last_undegraded":"2024-04-26T07:28:32.138789+0000","last_fullsized":"2024-04-26T07:28:32.138789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140217+0000","last_change":"2024-04-26T07:28:31.167012+0000","last_active":"2024-04-26T07:28:32.140217+0000","last_peered":"2024-04-26T07:28:32.140217+0000","last_clean":"2024-04-26T07:28:32.140217+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:28:32.140217+0000","last_undegraded":"2024-04-26T07:28:32.140217+0000","last_fullsized":"2024-04-26T07:28:32.140217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140887+0000","last_change":"2024-04-26T07:28:31.166221+0000","last_active":"2024-04-26T07:28:32.140887+0000","last_peered":"2024-04-26T07:28:32.140887+0000","last_clean":"2024-04-26T07:28:32.140887+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:28:32.140887+0000","last_undegraded":"2024-04-26T07:28:32.140887+0000","last_fullsized":"2024-04-26T07:28:32.140887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138879+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:32.138879+0000","last_peered":"2024-04-26T07:28:32.138879+0000","last_clean":"2024-04-26T07:28:32.138879+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:32.138879+0000","last_undegraded":"2024-04-26T07:28:32.138879+0000","last_fullsized":"2024-04-26T07:28:32.138879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142710+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:32.142710+0000","last_peered":"2024-04-26T07:28:32.142710+0000","last_clean":"2024-04-26T07:28:32.142710+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:32.142710+0000","last_undegraded":"2024-04-26T07:28:32.142710+0000","last_fullsized":"2024-04-26T07:28:32.142710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143257+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:32.143257+0000","last_peered":"2024-04-26T07:28:32.143257+0000","last_clean":"2024-04-26T07:28:32.143257+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:32.143257+0000","last_undegraded":"2024-04-26T07:28:32.143257+0000","last_fullsized":"2024-04-26T07:28:32.143257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142802+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:32.142802+0000","last_peered":"2024-04-26T07:28:32.142802+0000","last_clean":"2024-04-26T07:28:32.142802+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:32.142802+0000","last_undegraded":"2024-04-26T07:28:32.142802+0000","last_fullsized":"2024-04-26T07:28:32.142802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139998+0000","last_change":"2024-04-26T07:28:31.161156+0000","last_active":"2024-04-26T07:28:32.139998+0000","last_peered":"2024-04-26T07:28:32.139998+0000","last_clean":"2024-04-26T07:28:32.139998+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:28:32.139998+0000","last_undegraded":"2024-04-26T07:28:32.139998+0000","last_fullsized":"2024-04-26T07:28:32.139998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139079+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:32.139079+0000","last_peered":"2024-04-26T07:28:32.139079+0000","last_clean":"2024-04-26T07:28:32.139079+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:32.139079+0000","last_undegraded":"2024-04-26T07:28:32.139079+0000","last_fullsized":"2024-04-26T07:28:32.139079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138354+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.138354+0000","last_peered":"2024-04-26T07:28:32.138354+0000","last_clean":"2024-04-26T07:28:32.138354+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:32.138354+0000","last_undegraded":"2024-04-26T07:28:32.138354+0000","last_fullsized":"2024-04-26T07:28:32.138354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142486+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:32.142486+0000","last_peered":"2024-04-26T07:28:32.142486+0000","last_clean":"2024-04-26T07:28:32.142486+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:32.142486+0000","last_undegraded":"2024-04-26T07:28:32.142486+0000","last_fullsized":"2024-04-26T07:28:32.142486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137844+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:32.137844+0000","last_peered":"2024-04-26T07:28:32.137844+0000","last_clean":"2024-04-26T07:28:32.137844+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:32.137844+0000","last_undegraded":"2024-04-26T07:28:32.137844+0000","last_fullsized":"2024-04-26T07:28:32.137844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140794+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.140794+0000","last_peered":"2024-04-26T07:28:32.140794+0000","last_clean":"2024-04-26T07:28:32.140794+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:32.140794+0000","last_undegraded":"2024-04-26T07:28:32.140794+0000","last_fullsized":"2024-04-26T07:28:32.140794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138683+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:32.138683+0000","last_peered":"2024-04-26T07:28:32.138683+0000","last_clean":"2024-04-26T07:28:32.138683+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:32.138683+0000","last_undegraded":"2024-04-26T07:28:32.138683+0000","last_fullsized":"2024-04-26T07:28:32.138683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.890710+0000","last_change":"2024-04-26T07:30:23.890791+0000","last_active":"2024-04-26T07:30:23.890710+0000","last_peered":"2024-04-26T07:30:23.890710+0000","last_clean":"2024-04-26T07:30:23.890710+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:30:23.890710+0000","last_undegraded":"2024-04-26T07:30:23.890710+0000","last_fullsized":"2024-04-26T07:30:23.890710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.890710+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:22.844919+0000","last_change":"2024-04-26T07:30:22.845011+0000","last_active":"2024-04-26T07:30:22.844919+0000","last_peered":"2024-04-26T07:30:22.844919+0000","last_clean":"2024-04-26T07:30:22.844919+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:30:22.844919+0000","last_undegraded":"2024-04-26T07:30:22.844919+0000","last_fullsized":"2024-04-26T07:30:22.844919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_clean_scrub_stamp":"2024-04-26T07:30:22.844919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142948+0000","last_change":"2024-04-26T07:28:31.186538+0000","last_active":"2024-04-26T07:28:32.142948+0000","last_peered":"2024-04-26T07:28:32.142948+0000","last_clean":"2024-04-26T07:28:32.142948+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:28:32.142948+0000","last_undegraded":"2024-04-26T07:28:32.142948+0000","last_fullsized":"2024-04-26T07:28:32.142948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847320+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:33.847320+0000","last_peered":"2024-04-26T07:28:33.847320+0000","last_clean":"2024-04-26T07:28:33.847320+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:33.847320+0000","last_undegraded":"2024-04-26T07:28:33.847320+0000","last_fullsized":"2024-04-26T07:28:33.847320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'9","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.580238+0000","last_change":"2024-04-26T07:30:25.580325+0000","last_active":"2024-04-26T07:30:25.580238+0000","last_peered":"2024-04-26T07:30:25.580238+0000","last_clean":"2024-04-26T07:30:25.580238+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:30:25.580238+0000","last_undegraded":"2024-04-26T07:30:25.580238+0000","last_fullsized":"2024-04-26T07:30:25.580238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'9","last_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_deep_scrub":"19'9","last_deep_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.580237+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137664+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:32.137664+0000","last_peered":"2024-04-26T07:28:32.137664+0000","last_clean":"2024-04-26T07:28:32.137664+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:32.137664+0000","last_undegraded":"2024-04-26T07:28:32.137664+0000","last_fullsized":"2024-04-26T07:28:32.137664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.163184+0000","last_change":"2024-04-26T07:30:15.163266+0000","last_active":"2024-04-26T07:30:15.163184+0000","last_peered":"2024-04-26T07:30:15.163184+0000","last_clean":"2024-04-26T07:30:15.163184+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:30:15.163184+0000","last_undegraded":"2024-04-26T07:30:15.163184+0000","last_fullsized":"2024-04-26T07:30:15.163184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.163183+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138363+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:32.138363+0000","last_peered":"2024-04-26T07:28:32.138363+0000","last_clean":"2024-04-26T07:28:32.138363+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:32.138363+0000","last_undegraded":"2024-04-26T07:28:32.138363+0000","last_fullsized":"2024-04-26T07:28:32.138363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.570415+0000","last_change":"2024-04-26T07:30:23.570499+0000","last_active":"2024-04-26T07:30:23.570415+0000","last_peered":"2024-04-26T07:30:23.570415+0000","last_clean":"2024-04-26T07:30:23.570415+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:30:23.570415+0000","last_undegraded":"2024-04-26T07:30:23.570415+0000","last_fullsized":"2024-04-26T07:30:23.570415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.570415+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138036+0000","last_change":"2024-04-26T07:28:31.160035+0000","last_active":"2024-04-26T07:28:32.138036+0000","last_peered":"2024-04-26T07:28:32.138036+0000","last_clean":"2024-04-26T07:28:32.138036+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:28:32.138036+0000","last_undegraded":"2024-04-26T07:28:32.138036+0000","last_fullsized":"2024-04-26T07:28:32.138036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'16","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:48.306404+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:29:48.306404+0000","last_peered":"2024-04-26T07:29:48.306404+0000","last_clean":"2024-04-26T07:29:48.306404+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:29:48.306404+0000","last_undegraded":"2024-04-26T07:29:48.306404+0000","last_fullsized":"2024-04-26T07:29:48.306404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.232011+0000","last_change":"2024-04-26T07:30:27.232105+0000","last_active":"2024-04-26T07:30:27.232011+0000","last_peered":"2024-04-26T07:30:27.232011+0000","last_clean":"2024-04-26T07:30:27.232011+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:30:27.232011+0000","last_undegraded":"2024-04-26T07:30:27.232011+0000","last_fullsized":"2024-04-26T07:30:27.232011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.232010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849427+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:33.849427+0000","last_peered":"2024-04-26T07:28:33.849427+0000","last_clean":"2024-04-26T07:28:33.849427+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:33.849427+0000","last_undegraded":"2024-04-26T07:28:33.849427+0000","last_fullsized":"2024-04-26T07:28:33.849427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137836+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:32.137836+0000","last_peered":"2024-04-26T07:28:32.137836+0000","last_clean":"2024-04-26T07:28:32.137836+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:32.137836+0000","last_undegraded":"2024-04-26T07:28:32.137836+0000","last_fullsized":"2024-04-26T07:28:32.137836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:21.505390+0000","last_change":"2024-04-26T07:30:21.505470+0000","last_active":"2024-04-26T07:30:21.505390+0000","last_peered":"2024-04-26T07:30:21.505390+0000","last_clean":"2024-04-26T07:30:21.505390+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:30:21.505390+0000","last_undegraded":"2024-04-26T07:30:21.505390+0000","last_fullsized":"2024-04-26T07:30:21.505390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_clean_scrub_stamp":"2024-04-26T07:30:21.505390+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139915+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:32.139915+0000","last_peered":"2024-04-26T07:28:32.139915+0000","last_clean":"2024-04-26T07:28:32.139915+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:32.139915+0000","last_undegraded":"2024-04-26T07:28:32.139915+0000","last_fullsized":"2024-04-26T07:28:32.139915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138176+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:32.138176+0000","last_peered":"2024-04-26T07:28:32.138176+0000","last_clean":"2024-04-26T07:28:32.138176+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:32.138176+0000","last_undegraded":"2024-04-26T07:28:32.138176+0000","last_fullsized":"2024-04-26T07:28:32.138176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143072+0000","last_change":"2024-04-26T07:28:31.178406+0000","last_active":"2024-04-26T07:28:32.143072+0000","last_peered":"2024-04-26T07:28:32.143072+0000","last_clean":"2024-04-26T07:28:32.143072+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:28:32.143072+0000","last_undegraded":"2024-04-26T07:28:32.143072+0000","last_fullsized":"2024-04-26T07:28:32.143072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'15","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:18.834721+0000","last_change":"2024-04-26T07:30:18.834800+0000","last_active":"2024-04-26T07:30:18.834721+0000","last_peered":"2024-04-26T07:30:18.834721+0000","last_clean":"2024-04-26T07:30:18.834721+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:30:18.834721+0000","last_undegraded":"2024-04-26T07:30:18.834721+0000","last_fullsized":"2024-04-26T07:30:18.834721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'15","last_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_deep_scrub":"19'15","last_deep_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_clean_scrub_stamp":"2024-04-26T07:30:18.834720+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139763+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:32.139763+0000","last_peered":"2024-04-26T07:28:32.139763+0000","last_clean":"2024-04-26T07:28:32.139763+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:32.139763+0000","last_undegraded":"2024-04-26T07:28:32.139763+0000","last_fullsized":"2024-04-26T07:28:32.139763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.546240+0000","last_change":"2024-04-26T07:30:20.546354+0000","last_active":"2024-04-26T07:30:20.546240+0000","last_peered":"2024-04-26T07:30:20.546240+0000","last_clean":"2024-04-26T07:30:20.546240+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:30:20.546240+0000","last_undegraded":"2024-04-26T07:30:20.546240+0000","last_fullsized":"2024-04-26T07:30:20.546240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.546239+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137801+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:32.137801+0000","last_peered":"2024-04-26T07:28:32.137801+0000","last_clean":"2024-04-26T07:28:32.137801+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:32.137801+0000","last_undegraded":"2024-04-26T07:28:32.137801+0000","last_fullsized":"2024-04-26T07:28:32.137801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:13.068833+0000","last_change":"2024-04-26T07:30:13.068913+0000","last_active":"2024-04-26T07:30:13.068833+0000","last_peered":"2024-04-26T07:30:13.068833+0000","last_clean":"2024-04-26T07:30:13.068833+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:30:13.068833+0000","last_undegraded":"2024-04-26T07:30:13.068833+0000","last_fullsized":"2024-04-26T07:30:13.068833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:13.068832+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138273+0000","last_change":"2024-04-26T07:28:31.157554+0000","last_active":"2024-04-26T07:28:32.138273+0000","last_peered":"2024-04-26T07:28:32.138273+0000","last_clean":"2024-04-26T07:28:32.138273+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:28:32.138273+0000","last_undegraded":"2024-04-26T07:28:32.138273+0000","last_fullsized":"2024-04-26T07:28:32.138273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140135+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:32.140135+0000","last_peered":"2024-04-26T07:28:32.140135+0000","last_clean":"2024-04-26T07:28:32.140135+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:32.140135+0000","last_undegraded":"2024-04-26T07:28:32.140135+0000","last_fullsized":"2024-04-26T07:28:32.140135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.148236+0000","last_change":"2024-04-26T07:30:20.148325+0000","last_active":"2024-04-26T07:30:20.148236+0000","last_peered":"2024-04-26T07:30:20.148236+0000","last_clean":"2024-04-26T07:30:20.148236+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:30:20.148236+0000","last_undegraded":"2024-04-26T07:30:20.148236+0000","last_fullsized":"2024-04-26T07:30:20.148236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.148235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.511807+0000","last_change":"2024-04-26T07:30:16.511900+0000","last_active":"2024-04-26T07:30:16.511807+0000","last_peered":"2024-04-26T07:30:16.511807+0000","last_clean":"2024-04-26T07:30:16.511807+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:30:16.511807+0000","last_undegraded":"2024-04-26T07:30:16.511807+0000","last_fullsized":"2024-04-26T07:30:16.511807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.511806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142942+0000","last_change":"2024-04-26T07:28:31.184150+0000","last_active":"2024-04-26T07:28:32.142942+0000","last_peered":"2024-04-26T07:28:32.142942+0000","last_clean":"2024-04-26T07:28:32.142942+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:28:32.142942+0000","last_undegraded":"2024-04-26T07:28:32.142942+0000","last_fullsized":"2024-04-26T07:28:32.142942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849085+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:33.849085+0000","last_peered":"2024-04-26T07:28:33.849085+0000","last_clean":"2024-04-26T07:28:33.849085+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:33.849085+0000","last_undegraded":"2024-04-26T07:28:33.849085+0000","last_fullsized":"2024-04-26T07:28:33.849085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142971+0000","last_change":"2024-04-26T07:28:31.165701+0000","last_active":"2024-04-26T07:28:32.142971+0000","last_peered":"2024-04-26T07:28:32.142971+0000","last_clean":"2024-04-26T07:28:32.142971+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:28:32.142971+0000","last_undegraded":"2024-04-26T07:28:32.142971+0000","last_fullsized":"2024-04-26T07:28:32.142971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.136266+0000","last_change":"2024-04-26T07:28:30.847334+0000","last_active":"2024-04-26T07:28:57.136266+0000","last_peered":"2024-04-26T07:28:57.136266+0000","last_clean":"2024-04-26T07:28:57.136266+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:28:57.136266+0000","last_undegraded":"2024-04-26T07:28:57.136266+0000","last_fullsized":"2024-04-26T07:28:57.136266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140027+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:32.140027+0000","last_peered":"2024-04-26T07:28:32.140027+0000","last_clean":"2024-04-26T07:28:32.140027+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:32.140027+0000","last_undegraded":"2024-04-26T07:28:32.140027+0000","last_fullsized":"2024-04-26T07:28:32.140027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848748+0000","last_change":"2024-04-26T07:28:30.859264+0000","last_active":"2024-04-26T07:28:33.848748+0000","last_peered":"2024-04-26T07:28:33.848748+0000","last_clean":"2024-04-26T07:28:33.848748+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:28:33.848748+0000","last_undegraded":"2024-04-26T07:28:33.848748+0000","last_fullsized":"2024-04-26T07:28:33.848748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.207071+0000","last_change":"2024-04-26T07:30:25.207160+0000","last_active":"2024-04-26T07:30:25.207071+0000","last_peered":"2024-04-26T07:30:25.207071+0000","last_clean":"2024-04-26T07:30:25.207071+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:30:25.207071+0000","last_undegraded":"2024-04-26T07:30:25.207071+0000","last_fullsized":"2024-04-26T07:30:25.207071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.207070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849508+0000","last_change":"2024-04-26T07:28:30.847723+0000","last_active":"2024-04-26T07:28:33.849508+0000","last_peered":"2024-04-26T07:28:33.849508+0000","last_clean":"2024-04-26T07:28:33.849508+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:28:33.849508+0000","last_undegraded":"2024-04-26T07:28:33.849508+0000","last_fullsized":"2024-04-26T07:28:33.849508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140916+0000","last_change":"2024-04-26T07:28:31.160095+0000","last_active":"2024-04-26T07:28:32.140916+0000","last_peered":"2024-04-26T07:28:32.140916+0000","last_clean":"2024-04-26T07:28:32.140916+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:28:32.140916+0000","last_undegraded":"2024-04-26T07:28:32.140916+0000","last_fullsized":"2024-04-26T07:28:32.140916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.867473+0000","last_change":"2024-04-26T07:30:09.867557+0000","last_active":"2024-04-26T07:30:09.867473+0000","last_peered":"2024-04-26T07:30:09.867473+0000","last_clean":"2024-04-26T07:30:09.867473+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:30:09.867473+0000","last_undegraded":"2024-04-26T07:30:09.867473+0000","last_fullsized":"2024-04-26T07:30:09.867473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.867473+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.023356+0000","last_change":"2024-04-26T07:30:11.023477+0000","last_active":"2024-04-26T07:30:11.023356+0000","last_peered":"2024-04-26T07:30:11.023356+0000","last_clean":"2024-04-26T07:30:11.023356+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:30:11.023356+0000","last_undegraded":"2024-04-26T07:30:11.023356+0000","last_fullsized":"2024-04-26T07:30:11.023356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.023356+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137905+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.137905+0000","last_peered":"2024-04-26T07:28:32.137905+0000","last_clean":"2024-04-26T07:28:32.137905+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:28:32.137905+0000","last_undegraded":"2024-04-26T07:28:32.137905+0000","last_fullsized":"2024-04-26T07:28:32.137905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:14.491026+0000","last_change":"2024-04-26T07:30:14.491123+0000","last_active":"2024-04-26T07:30:14.491026+0000","last_peered":"2024-04-26T07:30:14.491026+0000","last_clean":"2024-04-26T07:30:14.491026+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:30:14.491026+0000","last_undegraded":"2024-04-26T07:30:14.491026+0000","last_fullsized":"2024-04-26T07:30:14.491026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_clean_scrub_stamp":"2024-04-26T07:30:14.491025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.413359+0000","last_change":"2024-04-26T07:30:09.413441+0000","last_active":"2024-04-26T07:30:09.413359+0000","last_peered":"2024-04-26T07:30:09.413359+0000","last_clean":"2024-04-26T07:30:09.413359+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:30:09.413359+0000","last_undegraded":"2024-04-26T07:30:09.413359+0000","last_fullsized":"2024-04-26T07:30:09.413359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.413358+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139154+0000","last_change":"2024-04-26T07:28:31.155206+0000","last_active":"2024-04-26T07:28:32.139154+0000","last_peered":"2024-04-26T07:28:32.139154+0000","last_clean":"2024-04-26T07:28:32.139154+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:28:32.139154+0000","last_undegraded":"2024-04-26T07:28:32.139154+0000","last_fullsized":"2024-04-26T07:28:32.139154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.028509+0000","last_change":"2024-04-26T07:30:08.028621+0000","last_active":"2024-04-26T07:30:08.028509+0000","last_peered":"2024-04-26T07:30:08.028509+0000","last_clean":"2024-04-26T07:30:08.028509+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:30:08.028509+0000","last_undegraded":"2024-04-26T07:30:08.028509+0000","last_fullsized":"2024-04-26T07:30:08.028509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.028509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.809606+0000","last_change":"2024-04-26T07:30:12.809726+0000","last_active":"2024-04-26T07:30:12.809606+0000","last_peered":"2024-04-26T07:30:12.809606+0000","last_clean":"2024-04-26T07:30:12.809606+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:30:12.809606+0000","last_undegraded":"2024-04-26T07:30:12.809606+0000","last_fullsized":"2024-04-26T07:30:12.809606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.809605+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140827+0000","last_change":"2024-04-26T07:28:31.178926+0000","last_active":"2024-04-26T07:28:32.140827+0000","last_peered":"2024-04-26T07:28:32.140827+0000","last_clean":"2024-04-26T07:28:32.140827+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:28:32.140827+0000","last_undegraded":"2024-04-26T07:28:32.140827+0000","last_fullsized":"2024-04-26T07:28:32.140827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.443421+0000","last_change":"2024-04-26T07:30:15.443501+0000","last_active":"2024-04-26T07:30:15.443421+0000","last_peered":"2024-04-26T07:30:15.443421+0000","last_clean":"2024-04-26T07:30:15.443421+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:30:15.443421+0000","last_undegraded":"2024-04-26T07:30:15.443421+0000","last_fullsized":"2024-04-26T07:30:15.443421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.443421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.891685+0000","last_change":"2024-04-26T07:30:08.891750+0000","last_active":"2024-04-26T07:30:08.891685+0000","last_peered":"2024-04-26T07:30:08.891685+0000","last_clean":"2024-04-26T07:30:08.891685+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:30:08.891685+0000","last_undegraded":"2024-04-26T07:30:08.891685+0000","last_fullsized":"2024-04-26T07:30:08.891685+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.891685+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.436730+0000","last_change":"2024-04-26T07:30:20.436817+0000","last_active":"2024-04-26T07:30:20.436730+0000","last_peered":"2024-04-26T07:30:20.436730+0000","last_clean":"2024-04-26T07:30:20.436730+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:30:20.436730+0000","last_undegraded":"2024-04-26T07:30:20.436730+0000","last_fullsized":"2024-04-26T07:30:20.436730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.436730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140556+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:32.140556+0000","last_peered":"2024-04-26T07:28:32.140556+0000","last_clean":"2024-04-26T07:28:32.140556+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:32.140556+0000","last_undegraded":"2024-04-26T07:28:32.140556+0000","last_fullsized":"2024-04-26T07:28:32.140556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.493074+0000","last_change":"2024-04-26T07:30:12.493165+0000","last_active":"2024-04-26T07:30:12.493074+0000","last_peered":"2024-04-26T07:30:12.493074+0000","last_clean":"2024-04-26T07:30:12.493074+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:30:12.493074+0000","last_undegraded":"2024-04-26T07:30:12.493074+0000","last_fullsized":"2024-04-26T07:30:12.493074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.493074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.440210+0000","last_change":"2024-04-26T07:30:08.440323+0000","last_active":"2024-04-26T07:30:08.440210+0000","last_peered":"2024-04-26T07:30:08.440210+0000","last_clean":"2024-04-26T07:30:08.440210+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:30:08.440210+0000","last_undegraded":"2024-04-26T07:30:08.440210+0000","last_fullsized":"2024-04-26T07:30:08.440210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.440209+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143152+0000","last_change":"2024-04-26T07:28:31.184182+0000","last_active":"2024-04-26T07:28:32.143152+0000","last_peered":"2024-04-26T07:28:32.143152+0000","last_clean":"2024-04-26T07:28:32.143152+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:28:32.143152+0000","last_undegraded":"2024-04-26T07:28:32.143152+0000","last_fullsized":"2024-04-26T07:28:32.143152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.416586+0000","last_change":"2024-04-26T07:30:16.416716+0000","last_active":"2024-04-26T07:30:16.416586+0000","last_peered":"2024-04-26T07:30:16.416586+0000","last_clean":"2024-04-26T07:30:16.416586+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:30:16.416586+0000","last_undegraded":"2024-04-26T07:30:16.416586+0000","last_fullsized":"2024-04-26T07:30:16.416586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.416585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.810615+0000","last_change":"2024-04-26T07:30:16.810700+0000","last_active":"2024-04-26T07:30:16.810615+0000","last_peered":"2024-04-26T07:30:16.810615+0000","last_clean":"2024-04-26T07:30:16.810615+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:30:16.810615+0000","last_undegraded":"2024-04-26T07:30:16.810615+0000","last_fullsized":"2024-04-26T07:30:16.810615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.810615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142850+0000","last_change":"2024-04-26T07:28:31.176018+0000","last_active":"2024-04-26T07:28:32.142850+0000","last_peered":"2024-04-26T07:28:32.142850+0000","last_clean":"2024-04-26T07:28:32.142850+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:28:32.142850+0000","last_undegraded":"2024-04-26T07:28:32.142850+0000","last_fullsized":"2024-04-26T07:28:32.142850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.848248+0000","last_change":"2024-04-26T07:28:30.854736+0000","last_active":"2024-04-26T07:28:33.848248+0000","last_peered":"2024-04-26T07:28:33.848248+0000","last_clean":"2024-04-26T07:28:33.848248+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:28:33.848248+0000","last_undegraded":"2024-04-26T07:28:33.848248+0000","last_fullsized":"2024-04-26T07:28:33.848248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.818279+0000","last_change":"2024-04-26T07:30:11.818359+0000","last_active":"2024-04-26T07:30:11.818279+0000","last_peered":"2024-04-26T07:30:11.818279+0000","last_clean":"2024-04-26T07:30:11.818279+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:30:11.818279+0000","last_undegraded":"2024-04-26T07:30:11.818279+0000","last_fullsized":"2024-04-26T07:30:11.818279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.818278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137320+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:32.137320+0000","last_peered":"2024-04-26T07:28:32.137320+0000","last_clean":"2024-04-26T07:28:32.137320+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:32.137320+0000","last_undegraded":"2024-04-26T07:28:32.137320+0000","last_fullsized":"2024-04-26T07:28:32.137320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:17.377065+0000","last_change":"2024-04-26T07:30:17.377162+0000","last_active":"2024-04-26T07:30:17.377065+0000","last_peered":"2024-04-26T07:30:17.377065+0000","last_clean":"2024-04-26T07:30:17.377065+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:30:17.377065+0000","last_undegraded":"2024-04-26T07:30:17.377065+0000","last_fullsized":"2024-04-26T07:30:17.377065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_clean_scrub_stamp":"2024-04-26T07:30:17.377064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.414289+0000","last_change":"2024-04-26T07:30:11.414367+0000","last_active":"2024-04-26T07:30:11.414289+0000","last_peered":"2024-04-26T07:30:11.414289+0000","last_clean":"2024-04-26T07:30:11.414289+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:30:11.414289+0000","last_undegraded":"2024-04-26T07:30:11.414289+0000","last_fullsized":"2024-04-26T07:30:11.414289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.414288+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:19.136227+0000","last_change":"2024-04-26T07:30:19.136319+0000","last_active":"2024-04-26T07:30:19.136227+0000","last_peered":"2024-04-26T07:30:19.136227+0000","last_clean":"2024-04-26T07:30:19.136227+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:30:19.136227+0000","last_undegraded":"2024-04-26T07:30:19.136227+0000","last_fullsized":"2024-04-26T07:30:19.136227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:19.136226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'10","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:28:57.139239+0000","last_change":"2024-04-26T07:28:30.845984+0000","last_active":"2024-04-26T07:28:57.139239+0000","last_peered":"2024-04-26T07:28:57.139239+0000","last_clean":"2024-04-26T07:28:57.139239+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:28:57.139239+0000","last_undegraded":"2024-04-26T07:28:57.139239+0000","last_fullsized":"2024-04-26T07:28:57.139239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140278+0000","last_change":"2024-04-26T07:28:31.156432+0000","last_active":"2024-04-26T07:28:32.140278+0000","last_peered":"2024-04-26T07:28:32.140278+0000","last_clean":"2024-04-26T07:28:32.140278+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:28:32.140278+0000","last_undegraded":"2024-04-26T07:28:32.140278+0000","last_fullsized":"2024-04-26T07:28:32.140278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.788374+0000","last_change":"2024-04-26T07:30:27.788453+0000","last_active":"2024-04-26T07:30:27.788374+0000","last_peered":"2024-04-26T07:30:27.788374+0000","last_clean":"2024-04-26T07:30:27.788374+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:30:27.788374+0000","last_undegraded":"2024-04-26T07:30:27.788374+0000","last_fullsized":"2024-04-26T07:30:27.788374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.788374+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140941+0000","last_change":"2024-04-26T07:28:31.166078+0000","last_active":"2024-04-26T07:28:32.140941+0000","last_peered":"2024-04-26T07:28:32.140941+0000","last_clean":"2024-04-26T07:28:32.140941+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:28:32.140941+0000","last_undegraded":"2024-04-26T07:28:32.140941+0000","last_fullsized":"2024-04-26T07:28:32.140941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140429+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:32.140429+0000","last_peered":"2024-04-26T07:28:32.140429+0000","last_clean":"2024-04-26T07:28:32.140429+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:32.140429+0000","last_undegraded":"2024-04-26T07:28:32.140429+0000","last_fullsized":"2024-04-26T07:28:32.140429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139495+0000","last_change":"2024-04-26T07:28:31.165245+0000","last_active":"2024-04-26T07:28:32.139495+0000","last_peered":"2024-04-26T07:28:32.139495+0000","last_clean":"2024-04-26T07:28:32.139495+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:28:32.139495+0000","last_undegraded":"2024-04-26T07:28:32.139495+0000","last_fullsized":"2024-04-26T07:28:32.139495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138254+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:32.138254+0000","last_peered":"2024-04-26T07:28:32.138254+0000","last_clean":"2024-04-26T07:28:32.138254+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:32.138254+0000","last_undegraded":"2024-04-26T07:28:32.138254+0000","last_fullsized":"2024-04-26T07:28:32.138254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143222+0000","last_change":"2024-04-26T07:28:30.849340+0000","last_active":"2024-04-26T07:28:32.143222+0000","last_peered":"2024-04-26T07:28:32.143222+0000","last_clean":"2024-04-26T07:28:32.143222+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:28:32.143222+0000","last_undegraded":"2024-04-26T07:28:32.143222+0000","last_fullsized":"2024-04-26T07:28:32.143222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139300+0000","last_change":"2024-04-26T07:28:31.163998+0000","last_active":"2024-04-26T07:28:32.139300+0000","last_peered":"2024-04-26T07:28:32.139300+0000","last_clean":"2024-04-26T07:28:32.139300+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:28:32.139300+0000","last_undegraded":"2024-04-26T07:28:32.139300+0000","last_fullsized":"2024-04-26T07:28:32.139300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138401+0000","last_change":"2024-04-26T07:28:31.159090+0000","last_active":"2024-04-26T07:28:32.138401+0000","last_peered":"2024-04-26T07:28:32.138401+0000","last_clean":"2024-04-26T07:28:32.138401+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:28:32.138401+0000","last_undegraded":"2024-04-26T07:28:32.138401+0000","last_fullsized":"2024-04-26T07:28:32.138401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143246+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:32.143246+0000","last_peered":"2024-04-26T07:28:32.143246+0000","last_clean":"2024-04-26T07:28:32.143246+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:32.143246+0000","last_undegraded":"2024-04-26T07:28:32.143246+0000","last_fullsized":"2024-04-26T07:28:32.143246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138871+0000","last_change":"2024-04-26T07:28:31.162436+0000","last_active":"2024-04-26T07:28:32.138871+0000","last_peered":"2024-04-26T07:28:32.138871+0000","last_clean":"2024-04-26T07:28:32.138871+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:28:32.138871+0000","last_undegraded":"2024-04-26T07:28:32.138871+0000","last_fullsized":"2024-04-26T07:28:32.138871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705692,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.27000000000000002,"15min":0.26700000000000002},"min":{"1min":0.20200000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.313,"5min":0.30099999999999999,"15min":0.29899999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.27000000000000002}]},{"osd":1,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.23100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.30599999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.25600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.312,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.25700000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.20999999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.30399999999999999,"15min":0.30599999999999999},"min":{"1min":0.20000000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.38800000000000001,"5min":0.442,"15min":0.442},"last":0.22800000000000001}]},{"osd":1,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.29699999999999999,"15min":0.29799999999999999},"min":{"1min":0.183,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.40999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.309,"5min":0.317,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.245}]},{"osd":3,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32600000000000001,"15min":0.32800000000000001},"min":{"1min":0.221,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47799999999999998,"5min":0.503,"15min":0.503},"last":0.317},{"interface":"front","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.25700000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.26700000000000002},"min":{"1min":0.189,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28799999999999998},"min":{"1min":0.20300000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.248}]},{"osd":2,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.313,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.311,"15min":0.309},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.312},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.313},"min":{"1min":0.23599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.316}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.29899999999999999,"15min":0.29799999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.318},"min":{"1min":0.218,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.435}]},{"osd":2,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50600000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.48899999999999999}]}]}]}} 2024-04-26T07:30:28.921 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.921 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.922 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.922 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.922 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.922 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.922 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.922 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.923 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.923 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.923 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.923 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.923 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.923 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.923 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.924 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.924 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.924 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.924 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.924 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.924 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.924 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.925 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.925 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.925 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.925 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.925 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.925 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.926 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.926 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.926 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.926 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.926 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.926 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.927 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.927 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.927 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.927 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.927 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.927 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.927 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.928 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.928 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.928 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.928 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.928 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.928 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.929 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.929 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.929 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.929 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.929 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.929 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.930 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.930 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.930 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.930 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.931 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.931 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.931 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.931 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.931 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.931 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.932 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.932 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.932 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.932 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.932 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.932 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.932 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.933 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.933 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.933 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.933 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:28.933 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:30:48.934 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:30:49.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.055+0000 7f508637b700 1 Processor -- start 2024-04-26T07:30:49.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f508637b700 1 -- start start 2024-04-26T07:30:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f508637b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f508009a8f0 0x7f5080136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f508637b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080136b50 0x7f5080140a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f508637b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508009b670 con 0x7f5080067500 2024-04-26T07:30:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f508637b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508009c380 con 0x7f508009a8f0 2024-04-26T07:30:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f508637b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50801361b0 con 0x7f5080136b50 2024-04-26T07:30:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f507f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f508009a8f0 0x7f5080136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f5084918700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080136b50 0x7f5080140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f507ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5080067500 0x7f508009bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55462/0 (socket says 172.21.15.31:55462) 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f507ffff700 1 -- 172.21.15.31:0/583769419 learned_addr learned my addr 172.21.15.31:0/583769419 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.056+0000 7f5084918700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080136b50 0x7f5080140a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49544/0 (socket says 172.21.15.31:49544) 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f5084918700 1 -- 172.21.15.31:0/583769419 >> v2:172.21.15.31:3300/0 conn(0x7f508009a8f0 msgr2=0x7f5080136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f5084918700 1 --2- 172.21.15.31:0/583769419 >> v2:172.21.15.31:3300/0 conn(0x7f508009a8f0 0x7f5080136660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f5084918700 1 -- 172.21.15.31:0/583769419 >> v1:172.21.15.31:6789/0 conn(0x7f5080067500 legacy=0x7f508009bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f5084918700 1 -- 172.21.15.31:0/583769419 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508009b400 con 0x7f5080136b50 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f507effd700 1 -- 172.21.15.31:0/583769419 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563022059 0 0) 0x7f508009b670 con 0x7f5080067500 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f507f7fe700 1 --2- 172.21.15.31:0/583769419 >> v2:172.21.15.31:3300/0 conn(0x7f508009a8f0 0x7f5080136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f5084918700 1 --2- 172.21.15.31:0/583769419 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080136b50 0x7f5080140a40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f50780032f0 tx=0x7f50780091d0).ready entity=mon.2 client_cookie=ccfb598edf7f7316 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f507effd700 1 -- 172.21.15.31:0/583769419 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f507800b6c0 con 0x7f5080136b50 2024-04-26T07:30:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f507effd700 1 -- 172.21.15.31:0/583769419 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507800b820 con 0x7f5080136b50 2024-04-26T07:30:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.057+0000 7f507effd700 1 -- 172.21.15.31:0/583769419 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f507800b990 con 0x7f5080136b50 2024-04-26T07:30:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.058+0000 7f508637b700 1 -- 172.21.15.31:0/583769419 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080136b50 msgr2=0x7f5080140a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.058+0000 7f508637b700 1 --2- 172.21.15.31:0/583769419 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080136b50 0x7f5080140a40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f50780032f0 tx=0x7f50780091d0).stop 2024-04-26T07:30:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.058+0000 7f508637b700 1 -- 172.21.15.31:0/583769419 shutdown_connections 2024-04-26T07:30:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.058+0000 7f508637b700 1 --2- 172.21.15.31:0/583769419 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080136b50 0x7f5080140a40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:49.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.058+0000 7f508637b700 1 --2- 172.21.15.31:0/583769419 >> v2:172.21.15.31:3300/0 conn(0x7f508009a8f0 0x7f5080136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:49.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.058+0000 7f508637b700 1 -- 172.21.15.31:0/583769419 >> 172.21.15.31:0/583769419 conn(0x7f508005cfb0 msgr2=0x7f5080062410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:49.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.058+0000 7f508637b700 1 -- 172.21.15.31:0/583769419 shutdown_connections 2024-04-26T07:30:49.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.058+0000 7f508637b700 1 -- 172.21.15.31:0/583769419 wait complete. 2024-04-26T07:30:49.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f508637b700 1 Processor -- start 2024-04-26T07:30:49.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f508637b700 1 -- start start 2024-04-26T07:30:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f508637b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080067500 0x7f5080148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f508637b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508009a8f0 0x7f5080145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:49.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f508637b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5080136b50 0x7f5080145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:30:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f508637b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50801454c0 con 0x7f5080136b50 2024-04-26T07:30:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f508637b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5080149790 con 0x7f508009a8f0 2024-04-26T07:30:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f508637b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5080138db0 con 0x7f5080067500 2024-04-26T07:30:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f507ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080067500 0x7f5080148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.059+0000 7f507ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080067500 0x7f5080148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49550/0 (socket says 172.21.15.31:49550) 2024-04-26T07:30:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507ffff700 1 -- 172.21.15.31:0/1426544155 learned_addr learned my addr 172.21.15.31:0/1426544155 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:30:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f5084918700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5080136b50 0x7f5080145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:49.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507f7fe700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508009a8f0 0x7f5080145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:30:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507ffff700 1 -- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508009a8f0 msgr2=0x7f5080145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507ffff700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508009a8f0 0x7f5080145840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507ffff700 1 -- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5080136b50 msgr2=0x7f5080145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507ffff700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5080136b50 0x7f5080145d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507ffff700 1 -- 172.21.15.31:0/1426544155 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507400b180 con 0x7f5080067500 2024-04-26T07:30:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f5084918700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5080136b50 0x7f5080145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:30:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507ffff700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080067500 0x7f5080148dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5070000bc0 tx=0x7f5070007a60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:30:49.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507d7fa700 1 -- 172.21.15.31:0/1426544155 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50700070d0 con 0x7f5080067500 2024-04-26T07:30:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507d7fa700 1 -- 172.21.15.31:0/1426544155 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070007230 con 0x7f5080067500 2024-04-26T07:30:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5078009470 con 0x7f5080067500 2024-04-26T07:30:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f507d7fa700 1 -- 172.21.15.31:0/1426544155 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5070005610 con 0x7f5080067500 2024-04-26T07:30:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.060+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5080138770 con 0x7f5080067500 2024-04-26T07:30:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.061+0000 7f507d7fa700 1 -- 172.21.15.31:0/1426544155 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5070010070 con 0x7f5080067500 2024-04-26T07:30:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.061+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50800946a0 con 0x7f5080067500 2024-04-26T07:30:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.061+0000 7f507d7fa700 1 -- 172.21.15.31:0/1426544155 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5070049ed0 con 0x7f5080067500 2024-04-26T07:30:49.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.064+0000 7f507d7fa700 1 -- 172.21.15.31:0/1426544155 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f507002edd0 con 0x7f5080067500 2024-04-26T07:30:49.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.178+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50801389c0 con 0x7f5060038e60 2024-04-26T07:30:49.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.184+0000 7f507d7fa700 1 -- 172.21.15.31:0/1426544155 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252165 (unknown 2965378022 0 1051197889) 0x7f507400b770 con 0x7f5060038e60 2024-04-26T07:30:49.188 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:30:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 >> v1:172.21.15.31:6816/39613 conn(0x7f5060038e60 legacy=0x7f506003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080067500 msgr2=0x7f5080148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:30:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080067500 0x7f5080148dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5070000bc0 tx=0x7f5070007a60).stop 2024-04-26T07:30:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 shutdown_connections 2024-04-26T07:30:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5080067500 0x7f5080148dc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5080136b50 0x7f5080145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 --2- 172.21.15.31:0/1426544155 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f508009a8f0 0x7f5080145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:30:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 >> 172.21.15.31:0/1426544155 conn(0x7f508005cfb0 msgr2=0x7f5080132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:30:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 shutdown_connections 2024-04-26T07:30:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:30:49.187+0000 7f508637b700 1 -- 172.21.15.31:0/1426544155 wait complete. 2024-04-26T07:30:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:30:49.197 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-26T07:30:48.005608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8826,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002792"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140126+0000","last_change":"2024-04-26T07:28:31.164518+0000","last_active":"2024-04-26T07:28:32.140126+0000","last_peered":"2024-04-26T07:28:32.140126+0000","last_clean":"2024-04-26T07:28:32.140126+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:28:32.140126+0000","last_undegraded":"2024-04-26T07:28:32.140126+0000","last_fullsized":"2024-04-26T07:28:32.140126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140737+0000","last_change":"2024-04-26T07:28:31.158544+0000","last_active":"2024-04-26T07:28:32.140737+0000","last_peered":"2024-04-26T07:28:32.140737+0000","last_clean":"2024-04-26T07:28:32.140737+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:28:32.140737+0000","last_undegraded":"2024-04-26T07:28:32.140737+0000","last_fullsized":"2024-04-26T07:28:32.140737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143288+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:32.143288+0000","last_peered":"2024-04-26T07:28:32.143288+0000","last_clean":"2024-04-26T07:28:32.143288+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:32.143288+0000","last_undegraded":"2024-04-26T07:28:32.143288+0000","last_fullsized":"2024-04-26T07:28:32.143288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143164+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:32.143164+0000","last_peered":"2024-04-26T07:28:32.143164+0000","last_clean":"2024-04-26T07:28:32.143164+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:32.143164+0000","last_undegraded":"2024-04-26T07:28:32.143164+0000","last_fullsized":"2024-04-26T07:28:32.143164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142620+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:32.142620+0000","last_peered":"2024-04-26T07:28:32.142620+0000","last_clean":"2024-04-26T07:28:32.142620+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:32.142620+0000","last_undegraded":"2024-04-26T07:28:32.142620+0000","last_fullsized":"2024-04-26T07:28:32.142620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137729+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:32.137729+0000","last_peered":"2024-04-26T07:28:32.137729+0000","last_clean":"2024-04-26T07:28:32.137729+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:32.137729+0000","last_undegraded":"2024-04-26T07:28:32.137729+0000","last_fullsized":"2024-04-26T07:28:32.137729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143368+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:32.143368+0000","last_peered":"2024-04-26T07:28:32.143368+0000","last_clean":"2024-04-26T07:28:32.143368+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:32.143368+0000","last_undegraded":"2024-04-26T07:28:32.143368+0000","last_fullsized":"2024-04-26T07:28:32.143368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138820+0000","last_change":"2024-04-26T07:28:31.178267+0000","last_active":"2024-04-26T07:28:32.138820+0000","last_peered":"2024-04-26T07:28:32.138820+0000","last_clean":"2024-04-26T07:28:32.138820+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:28:32.138820+0000","last_undegraded":"2024-04-26T07:28:32.138820+0000","last_fullsized":"2024-04-26T07:28:32.138820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138789+0000","last_change":"2024-04-26T07:28:31.178562+0000","last_active":"2024-04-26T07:28:32.138789+0000","last_peered":"2024-04-26T07:28:32.138789+0000","last_clean":"2024-04-26T07:28:32.138789+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:28:32.138789+0000","last_undegraded":"2024-04-26T07:28:32.138789+0000","last_fullsized":"2024-04-26T07:28:32.138789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:47.333000+0000","last_change":"2024-04-26T07:30:47.333131+0000","last_active":"2024-04-26T07:30:47.333000+0000","last_peered":"2024-04-26T07:30:47.333000+0000","last_clean":"2024-04-26T07:30:47.333000+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:30:47.333000+0000","last_undegraded":"2024-04-26T07:30:47.333000+0000","last_fullsized":"2024-04-26T07:30:47.333000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_clean_scrub_stamp":"2024-04-26T07:30:47.333000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.307226+0000","last_change":"2024-04-26T07:30:42.307331+0000","last_active":"2024-04-26T07:30:42.307226+0000","last_peered":"2024-04-26T07:30:42.307226+0000","last_clean":"2024-04-26T07:30:42.307226+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:30:42.307226+0000","last_undegraded":"2024-04-26T07:30:42.307226+0000","last_fullsized":"2024-04-26T07:30:42.307226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.307226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138879+0000","last_change":"2024-04-26T07:28:31.159828+0000","last_active":"2024-04-26T07:28:32.138879+0000","last_peered":"2024-04-26T07:28:32.138879+0000","last_clean":"2024-04-26T07:28:32.138879+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:28:32.138879+0000","last_undegraded":"2024-04-26T07:28:32.138879+0000","last_fullsized":"2024-04-26T07:28:32.138879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142710+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:32.142710+0000","last_peered":"2024-04-26T07:28:32.142710+0000","last_clean":"2024-04-26T07:28:32.142710+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:32.142710+0000","last_undegraded":"2024-04-26T07:28:32.142710+0000","last_fullsized":"2024-04-26T07:28:32.142710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143257+0000","last_change":"2024-04-26T07:28:31.178197+0000","last_active":"2024-04-26T07:28:32.143257+0000","last_peered":"2024-04-26T07:28:32.143257+0000","last_clean":"2024-04-26T07:28:32.143257+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:28:32.143257+0000","last_undegraded":"2024-04-26T07:28:32.143257+0000","last_fullsized":"2024-04-26T07:28:32.143257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142802+0000","last_change":"2024-04-26T07:28:31.176683+0000","last_active":"2024-04-26T07:28:32.142802+0000","last_peered":"2024-04-26T07:28:32.142802+0000","last_clean":"2024-04-26T07:28:32.142802+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:28:32.142802+0000","last_undegraded":"2024-04-26T07:28:32.142802+0000","last_fullsized":"2024-04-26T07:28:32.142802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:40.294718+0000","last_change":"2024-04-26T07:30:40.294811+0000","last_active":"2024-04-26T07:30:40.294718+0000","last_peered":"2024-04-26T07:30:40.294718+0000","last_clean":"2024-04-26T07:30:40.294718+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:30:40.294718+0000","last_undegraded":"2024-04-26T07:30:40.294718+0000","last_fullsized":"2024-04-26T07:30:40.294718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_clean_scrub_stamp":"2024-04-26T07:30:40.294717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139079+0000","last_change":"2024-04-26T07:28:31.174412+0000","last_active":"2024-04-26T07:28:32.139079+0000","last_peered":"2024-04-26T07:28:32.139079+0000","last_clean":"2024-04-26T07:28:32.139079+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:28:32.139079+0000","last_undegraded":"2024-04-26T07:28:32.139079+0000","last_fullsized":"2024-04-26T07:28:32.139079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138354+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.138354+0000","last_peered":"2024-04-26T07:28:32.138354+0000","last_clean":"2024-04-26T07:28:32.138354+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:28:32.138354+0000","last_undegraded":"2024-04-26T07:28:32.138354+0000","last_fullsized":"2024-04-26T07:28:32.138354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142486+0000","last_change":"2024-04-26T07:28:31.178950+0000","last_active":"2024-04-26T07:28:32.142486+0000","last_peered":"2024-04-26T07:28:32.142486+0000","last_clean":"2024-04-26T07:28:32.142486+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:28:32.142486+0000","last_undegraded":"2024-04-26T07:28:32.142486+0000","last_fullsized":"2024-04-26T07:28:32.142486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137844+0000","last_change":"2024-04-26T07:28:31.158505+0000","last_active":"2024-04-26T07:28:32.137844+0000","last_peered":"2024-04-26T07:28:32.137844+0000","last_clean":"2024-04-26T07:28:32.137844+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:28:32.137844+0000","last_undegraded":"2024-04-26T07:28:32.137844+0000","last_fullsized":"2024-04-26T07:28:32.137844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140794+0000","last_change":"2024-04-26T07:28:31.159967+0000","last_active":"2024-04-26T07:28:32.140794+0000","last_peered":"2024-04-26T07:28:32.140794+0000","last_clean":"2024-04-26T07:28:32.140794+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:28:32.140794+0000","last_undegraded":"2024-04-26T07:28:32.140794+0000","last_fullsized":"2024-04-26T07:28:32.140794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138683+0000","last_change":"2024-04-26T07:28:31.159602+0000","last_active":"2024-04-26T07:28:32.138683+0000","last_peered":"2024-04-26T07:28:32.138683+0000","last_clean":"2024-04-26T07:28:32.138683+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:28:32.138683+0000","last_undegraded":"2024-04-26T07:28:32.138683+0000","last_fullsized":"2024-04-26T07:28:32.138683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.890710+0000","last_change":"2024-04-26T07:30:23.890791+0000","last_active":"2024-04-26T07:30:23.890710+0000","last_peered":"2024-04-26T07:30:23.890710+0000","last_clean":"2024-04-26T07:30:23.890710+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:30:23.890710+0000","last_undegraded":"2024-04-26T07:30:23.890710+0000","last_fullsized":"2024-04-26T07:30:23.890710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.890710+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:22.844919+0000","last_change":"2024-04-26T07:30:22.845011+0000","last_active":"2024-04-26T07:30:22.844919+0000","last_peered":"2024-04-26T07:30:22.844919+0000","last_clean":"2024-04-26T07:30:22.844919+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:30:22.844919+0000","last_undegraded":"2024-04-26T07:30:22.844919+0000","last_fullsized":"2024-04-26T07:30:22.844919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_clean_scrub_stamp":"2024-04-26T07:30:22.844919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.440808+0000","last_change":"2024-04-26T07:30:44.440891+0000","last_active":"2024-04-26T07:30:44.440808+0000","last_peered":"2024-04-26T07:30:44.440808+0000","last_clean":"2024-04-26T07:30:44.440808+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:30:44.440808+0000","last_undegraded":"2024-04-26T07:30:44.440808+0000","last_fullsized":"2024-04-26T07:30:44.440808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.440807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847320+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:33.847320+0000","last_peered":"2024-04-26T07:28:33.847320+0000","last_clean":"2024-04-26T07:28:33.847320+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:33.847320+0000","last_undegraded":"2024-04-26T07:28:33.847320+0000","last_fullsized":"2024-04-26T07:28:33.847320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'9","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.580238+0000","last_change":"2024-04-26T07:30:25.580325+0000","last_active":"2024-04-26T07:30:25.580238+0000","last_peered":"2024-04-26T07:30:25.580238+0000","last_clean":"2024-04-26T07:30:25.580238+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:30:25.580238+0000","last_undegraded":"2024-04-26T07:30:25.580238+0000","last_fullsized":"2024-04-26T07:30:25.580238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'9","last_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_deep_scrub":"19'9","last_deep_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.580237+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137664+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:32.137664+0000","last_peered":"2024-04-26T07:28:32.137664+0000","last_clean":"2024-04-26T07:28:32.137664+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:32.137664+0000","last_undegraded":"2024-04-26T07:28:32.137664+0000","last_fullsized":"2024-04-26T07:28:32.137664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.163184+0000","last_change":"2024-04-26T07:30:15.163266+0000","last_active":"2024-04-26T07:30:15.163184+0000","last_peered":"2024-04-26T07:30:15.163184+0000","last_clean":"2024-04-26T07:30:15.163184+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:30:15.163184+0000","last_undegraded":"2024-04-26T07:30:15.163184+0000","last_fullsized":"2024-04-26T07:30:15.163184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.163183+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138363+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:32.138363+0000","last_peered":"2024-04-26T07:28:32.138363+0000","last_clean":"2024-04-26T07:28:32.138363+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:32.138363+0000","last_undegraded":"2024-04-26T07:28:32.138363+0000","last_fullsized":"2024-04-26T07:28:32.138363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.570415+0000","last_change":"2024-04-26T07:30:23.570499+0000","last_active":"2024-04-26T07:30:23.570415+0000","last_peered":"2024-04-26T07:30:23.570415+0000","last_clean":"2024-04-26T07:30:23.570415+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:30:23.570415+0000","last_undegraded":"2024-04-26T07:30:23.570415+0000","last_fullsized":"2024-04-26T07:30:23.570415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.570415+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.011724+0000","last_change":"2024-04-26T07:30:44.011821+0000","last_active":"2024-04-26T07:30:44.011724+0000","last_peered":"2024-04-26T07:30:44.011724+0000","last_clean":"2024-04-26T07:30:44.011724+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:30:44.011724+0000","last_undegraded":"2024-04-26T07:30:44.011724+0000","last_fullsized":"2024-04-26T07:30:44.011724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.011723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'16","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:29:48.306404+0000","last_change":"2024-04-26T07:28:30.857487+0000","last_active":"2024-04-26T07:29:48.306404+0000","last_peered":"2024-04-26T07:29:48.306404+0000","last_clean":"2024-04-26T07:29:48.306404+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:29:48.306404+0000","last_undegraded":"2024-04-26T07:29:48.306404+0000","last_fullsized":"2024-04-26T07:29:48.306404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.232011+0000","last_change":"2024-04-26T07:30:27.232105+0000","last_active":"2024-04-26T07:30:27.232011+0000","last_peered":"2024-04-26T07:30:27.232011+0000","last_clean":"2024-04-26T07:30:27.232011+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:30:27.232011+0000","last_undegraded":"2024-04-26T07:30:27.232011+0000","last_fullsized":"2024-04-26T07:30:27.232011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.232010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849427+0000","last_change":"2024-04-26T07:28:30.852634+0000","last_active":"2024-04-26T07:28:33.849427+0000","last_peered":"2024-04-26T07:28:33.849427+0000","last_clean":"2024-04-26T07:28:33.849427+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:28:33.849427+0000","last_undegraded":"2024-04-26T07:28:33.849427+0000","last_fullsized":"2024-04-26T07:28:33.849427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137836+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:32.137836+0000","last_peered":"2024-04-26T07:28:32.137836+0000","last_clean":"2024-04-26T07:28:32.137836+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:32.137836+0000","last_undegraded":"2024-04-26T07:28:32.137836+0000","last_fullsized":"2024-04-26T07:28:32.137836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:21.505390+0000","last_change":"2024-04-26T07:30:21.505470+0000","last_active":"2024-04-26T07:30:21.505390+0000","last_peered":"2024-04-26T07:30:21.505390+0000","last_clean":"2024-04-26T07:30:21.505390+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:30:21.505390+0000","last_undegraded":"2024-04-26T07:30:21.505390+0000","last_fullsized":"2024-04-26T07:30:21.505390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_clean_scrub_stamp":"2024-04-26T07:30:21.505390+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139915+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:32.139915+0000","last_peered":"2024-04-26T07:28:32.139915+0000","last_clean":"2024-04-26T07:28:32.139915+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:32.139915+0000","last_undegraded":"2024-04-26T07:28:32.139915+0000","last_fullsized":"2024-04-26T07:28:32.139915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138176+0000","last_change":"2024-04-26T07:28:30.859450+0000","last_active":"2024-04-26T07:28:32.138176+0000","last_peered":"2024-04-26T07:28:32.138176+0000","last_clean":"2024-04-26T07:28:32.138176+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:28:32.138176+0000","last_undegraded":"2024-04-26T07:28:32.138176+0000","last_fullsized":"2024-04-26T07:28:32.138176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.427936+0000","last_change":"2024-04-26T07:30:42.428022+0000","last_active":"2024-04-26T07:30:42.427936+0000","last_peered":"2024-04-26T07:30:42.427936+0000","last_clean":"2024-04-26T07:30:42.427936+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:30:42.427936+0000","last_undegraded":"2024-04-26T07:30:42.427936+0000","last_fullsized":"2024-04-26T07:30:42.427936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.427935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'15","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:18.834721+0000","last_change":"2024-04-26T07:30:18.834800+0000","last_active":"2024-04-26T07:30:18.834721+0000","last_peered":"2024-04-26T07:30:18.834721+0000","last_clean":"2024-04-26T07:30:18.834721+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:30:18.834721+0000","last_undegraded":"2024-04-26T07:30:18.834721+0000","last_fullsized":"2024-04-26T07:30:18.834721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'15","last_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_deep_scrub":"19'15","last_deep_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_clean_scrub_stamp":"2024-04-26T07:30:18.834720+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139763+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:32.139763+0000","last_peered":"2024-04-26T07:28:32.139763+0000","last_clean":"2024-04-26T07:28:32.139763+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:32.139763+0000","last_undegraded":"2024-04-26T07:28:32.139763+0000","last_fullsized":"2024-04-26T07:28:32.139763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.546240+0000","last_change":"2024-04-26T07:30:20.546354+0000","last_active":"2024-04-26T07:30:20.546240+0000","last_peered":"2024-04-26T07:30:20.546240+0000","last_clean":"2024-04-26T07:30:20.546240+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:30:20.546240+0000","last_undegraded":"2024-04-26T07:30:20.546240+0000","last_fullsized":"2024-04-26T07:30:20.546240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.546239+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137801+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:32.137801+0000","last_peered":"2024-04-26T07:28:32.137801+0000","last_clean":"2024-04-26T07:28:32.137801+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:32.137801+0000","last_undegraded":"2024-04-26T07:28:32.137801+0000","last_fullsized":"2024-04-26T07:28:32.137801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:13.068833+0000","last_change":"2024-04-26T07:30:13.068913+0000","last_active":"2024-04-26T07:30:13.068833+0000","last_peered":"2024-04-26T07:30:13.068833+0000","last_clean":"2024-04-26T07:30:13.068833+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:30:13.068833+0000","last_undegraded":"2024-04-26T07:30:13.068833+0000","last_fullsized":"2024-04-26T07:30:13.068833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:13.068832+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.955449+0000","last_change":"2024-04-26T07:30:38.955557+0000","last_active":"2024-04-26T07:30:38.955449+0000","last_peered":"2024-04-26T07:30:38.955449+0000","last_clean":"2024-04-26T07:30:38.955449+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:30:38.955449+0000","last_undegraded":"2024-04-26T07:30:38.955449+0000","last_fullsized":"2024-04-26T07:30:38.955449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.955449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140135+0000","last_change":"2024-04-26T07:28:30.854461+0000","last_active":"2024-04-26T07:28:32.140135+0000","last_peered":"2024-04-26T07:28:32.140135+0000","last_clean":"2024-04-26T07:28:32.140135+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:28:32.140135+0000","last_undegraded":"2024-04-26T07:28:32.140135+0000","last_fullsized":"2024-04-26T07:28:32.140135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.148236+0000","last_change":"2024-04-26T07:30:20.148325+0000","last_active":"2024-04-26T07:30:20.148236+0000","last_peered":"2024-04-26T07:30:20.148236+0000","last_clean":"2024-04-26T07:30:20.148236+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:30:20.148236+0000","last_undegraded":"2024-04-26T07:30:20.148236+0000","last_fullsized":"2024-04-26T07:30:20.148236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.148235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.511807+0000","last_change":"2024-04-26T07:30:16.511900+0000","last_active":"2024-04-26T07:30:16.511807+0000","last_peered":"2024-04-26T07:30:16.511807+0000","last_clean":"2024-04-26T07:30:16.511807+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:30:16.511807+0000","last_undegraded":"2024-04-26T07:30:16.511807+0000","last_fullsized":"2024-04-26T07:30:16.511807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.511806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:34.479850+0000","last_change":"2024-04-26T07:30:34.479942+0000","last_active":"2024-04-26T07:30:34.479850+0000","last_peered":"2024-04-26T07:30:34.479850+0000","last_clean":"2024-04-26T07:30:34.479850+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:30:34.479850+0000","last_undegraded":"2024-04-26T07:30:34.479850+0000","last_fullsized":"2024-04-26T07:30:34.479850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_clean_scrub_stamp":"2024-04-26T07:30:34.479849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.849085+0000","last_change":"2024-04-26T07:28:30.853892+0000","last_active":"2024-04-26T07:28:33.849085+0000","last_peered":"2024-04-26T07:28:33.849085+0000","last_clean":"2024-04-26T07:28:33.849085+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:28:33.849085+0000","last_undegraded":"2024-04-26T07:28:33.849085+0000","last_fullsized":"2024-04-26T07:28:33.849085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.454434+0000","last_change":"2024-04-26T07:30:38.454554+0000","last_active":"2024-04-26T07:30:38.454434+0000","last_peered":"2024-04-26T07:30:38.454434+0000","last_clean":"2024-04-26T07:30:38.454434+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:30:38.454434+0000","last_undegraded":"2024-04-26T07:30:38.454434+0000","last_fullsized":"2024-04-26T07:30:38.454434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.454433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.698682+0000","last_change":"2024-04-26T07:30:42.698763+0000","last_active":"2024-04-26T07:30:42.698682+0000","last_peered":"2024-04-26T07:30:42.698682+0000","last_clean":"2024-04-26T07:30:42.698682+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:30:42.698682+0000","last_undegraded":"2024-04-26T07:30:42.698682+0000","last_fullsized":"2024-04-26T07:30:42.698682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.698682+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140027+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:32.140027+0000","last_peered":"2024-04-26T07:28:32.140027+0000","last_clean":"2024-04-26T07:28:32.140027+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:32.140027+0000","last_undegraded":"2024-04-26T07:28:32.140027+0000","last_fullsized":"2024-04-26T07:28:32.140027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:35.647109+0000","last_change":"2024-04-26T07:30:35.647193+0000","last_active":"2024-04-26T07:30:35.647109+0000","last_peered":"2024-04-26T07:30:35.647109+0000","last_clean":"2024-04-26T07:30:35.647109+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:30:35.647109+0000","last_undegraded":"2024-04-26T07:30:35.647109+0000","last_fullsized":"2024-04-26T07:30:35.647109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_clean_scrub_stamp":"2024-04-26T07:30:35.647108+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.207071+0000","last_change":"2024-04-26T07:30:25.207160+0000","last_active":"2024-04-26T07:30:25.207071+0000","last_peered":"2024-04-26T07:30:25.207071+0000","last_clean":"2024-04-26T07:30:25.207071+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:30:25.207071+0000","last_undegraded":"2024-04-26T07:30:25.207071+0000","last_fullsized":"2024-04-26T07:30:25.207071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.207070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.679673+0000","last_change":"2024-04-26T07:30:33.679748+0000","last_active":"2024-04-26T07:30:33.679673+0000","last_peered":"2024-04-26T07:30:33.679673+0000","last_clean":"2024-04-26T07:30:33.679673+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:30:33.679673+0000","last_undegraded":"2024-04-26T07:30:33.679673+0000","last_fullsized":"2024-04-26T07:30:33.679673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.679672+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:43.016723+0000","last_change":"2024-04-26T07:30:43.016816+0000","last_active":"2024-04-26T07:30:43.016723+0000","last_peered":"2024-04-26T07:30:43.016723+0000","last_clean":"2024-04-26T07:30:43.016723+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:30:43.016723+0000","last_undegraded":"2024-04-26T07:30:43.016723+0000","last_fullsized":"2024-04-26T07:30:43.016723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:43.016723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.867473+0000","last_change":"2024-04-26T07:30:09.867557+0000","last_active":"2024-04-26T07:30:09.867473+0000","last_peered":"2024-04-26T07:30:09.867473+0000","last_clean":"2024-04-26T07:30:09.867473+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:30:09.867473+0000","last_undegraded":"2024-04-26T07:30:09.867473+0000","last_fullsized":"2024-04-26T07:30:09.867473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.867473+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.023356+0000","last_change":"2024-04-26T07:30:11.023477+0000","last_active":"2024-04-26T07:30:11.023356+0000","last_peered":"2024-04-26T07:30:11.023356+0000","last_clean":"2024-04-26T07:30:11.023356+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:30:11.023356+0000","last_undegraded":"2024-04-26T07:30:11.023356+0000","last_fullsized":"2024-04-26T07:30:11.023356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.023356+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:30.811830+0000","last_change":"2024-04-26T07:30:30.811917+0000","last_active":"2024-04-26T07:30:30.811830+0000","last_peered":"2024-04-26T07:30:30.811830+0000","last_clean":"2024-04-26T07:30:30.811830+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:30:30.811830+0000","last_undegraded":"2024-04-26T07:30:30.811830+0000","last_fullsized":"2024-04-26T07:30:30.811830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_clean_scrub_stamp":"2024-04-26T07:30:30.811830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:14.491026+0000","last_change":"2024-04-26T07:30:14.491123+0000","last_active":"2024-04-26T07:30:14.491026+0000","last_peered":"2024-04-26T07:30:14.491026+0000","last_clean":"2024-04-26T07:30:14.491026+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:30:14.491026+0000","last_undegraded":"2024-04-26T07:30:14.491026+0000","last_fullsized":"2024-04-26T07:30:14.491026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_clean_scrub_stamp":"2024-04-26T07:30:14.491025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.413359+0000","last_change":"2024-04-26T07:30:09.413441+0000","last_active":"2024-04-26T07:30:09.413359+0000","last_peered":"2024-04-26T07:30:09.413359+0000","last_clean":"2024-04-26T07:30:09.413359+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:30:09.413359+0000","last_undegraded":"2024-04-26T07:30:09.413359+0000","last_fullsized":"2024-04-26T07:30:09.413359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.413358+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.849915+0000","last_change":"2024-04-26T07:30:31.850005+0000","last_active":"2024-04-26T07:30:31.849915+0000","last_peered":"2024-04-26T07:30:31.849915+0000","last_clean":"2024-04-26T07:30:31.849915+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:30:31.849915+0000","last_undegraded":"2024-04-26T07:30:31.849915+0000","last_fullsized":"2024-04-26T07:30:31.849915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.849914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.028509+0000","last_change":"2024-04-26T07:30:08.028621+0000","last_active":"2024-04-26T07:30:08.028509+0000","last_peered":"2024-04-26T07:30:08.028509+0000","last_clean":"2024-04-26T07:30:08.028509+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:30:08.028509+0000","last_undegraded":"2024-04-26T07:30:08.028509+0000","last_fullsized":"2024-04-26T07:30:08.028509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.028509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.809606+0000","last_change":"2024-04-26T07:30:12.809726+0000","last_active":"2024-04-26T07:30:12.809606+0000","last_peered":"2024-04-26T07:30:12.809606+0000","last_clean":"2024-04-26T07:30:12.809606+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:30:12.809606+0000","last_undegraded":"2024-04-26T07:30:12.809606+0000","last_fullsized":"2024-04-26T07:30:12.809606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.809605+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.923160+0000","last_change":"2024-04-26T07:30:33.923250+0000","last_active":"2024-04-26T07:30:33.923160+0000","last_peered":"2024-04-26T07:30:33.923160+0000","last_clean":"2024-04-26T07:30:33.923160+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:30:33.923160+0000","last_undegraded":"2024-04-26T07:30:33.923160+0000","last_fullsized":"2024-04-26T07:30:33.923160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.923160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.443421+0000","last_change":"2024-04-26T07:30:15.443501+0000","last_active":"2024-04-26T07:30:15.443421+0000","last_peered":"2024-04-26T07:30:15.443421+0000","last_clean":"2024-04-26T07:30:15.443421+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:30:15.443421+0000","last_undegraded":"2024-04-26T07:30:15.443421+0000","last_fullsized":"2024-04-26T07:30:15.443421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.443421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.891685+0000","last_change":"2024-04-26T07:30:08.891750+0000","last_active":"2024-04-26T07:30:08.891685+0000","last_peered":"2024-04-26T07:30:08.891685+0000","last_clean":"2024-04-26T07:30:08.891685+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:30:08.891685+0000","last_undegraded":"2024-04-26T07:30:08.891685+0000","last_fullsized":"2024-04-26T07:30:08.891685+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.891685+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.436730+0000","last_change":"2024-04-26T07:30:20.436817+0000","last_active":"2024-04-26T07:30:20.436730+0000","last_peered":"2024-04-26T07:30:20.436730+0000","last_clean":"2024-04-26T07:30:20.436730+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:30:20.436730+0000","last_undegraded":"2024-04-26T07:30:20.436730+0000","last_fullsized":"2024-04-26T07:30:20.436730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.436730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140556+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:32.140556+0000","last_peered":"2024-04-26T07:28:32.140556+0000","last_clean":"2024-04-26T07:28:32.140556+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:32.140556+0000","last_undegraded":"2024-04-26T07:28:32.140556+0000","last_fullsized":"2024-04-26T07:28:32.140556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.493074+0000","last_change":"2024-04-26T07:30:12.493165+0000","last_active":"2024-04-26T07:30:12.493074+0000","last_peered":"2024-04-26T07:30:12.493074+0000","last_clean":"2024-04-26T07:30:12.493074+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:30:12.493074+0000","last_undegraded":"2024-04-26T07:30:12.493074+0000","last_fullsized":"2024-04-26T07:30:12.493074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.493074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.440210+0000","last_change":"2024-04-26T07:30:08.440323+0000","last_active":"2024-04-26T07:30:08.440210+0000","last_peered":"2024-04-26T07:30:08.440210+0000","last_clean":"2024-04-26T07:30:08.440210+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:30:08.440210+0000","last_undegraded":"2024-04-26T07:30:08.440210+0000","last_fullsized":"2024-04-26T07:30:08.440210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.440209+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.503368+0000","last_change":"2024-04-26T07:30:33.503463+0000","last_active":"2024-04-26T07:30:33.503368+0000","last_peered":"2024-04-26T07:30:33.503368+0000","last_clean":"2024-04-26T07:30:33.503368+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:30:33.503368+0000","last_undegraded":"2024-04-26T07:30:33.503368+0000","last_fullsized":"2024-04-26T07:30:33.503368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.503367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.416586+0000","last_change":"2024-04-26T07:30:16.416716+0000","last_active":"2024-04-26T07:30:16.416586+0000","last_peered":"2024-04-26T07:30:16.416586+0000","last_clean":"2024-04-26T07:30:16.416586+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:30:16.416586+0000","last_undegraded":"2024-04-26T07:30:16.416586+0000","last_fullsized":"2024-04-26T07:30:16.416586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.416585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.810615+0000","last_change":"2024-04-26T07:30:16.810700+0000","last_active":"2024-04-26T07:30:16.810615+0000","last_peered":"2024-04-26T07:30:16.810615+0000","last_clean":"2024-04-26T07:30:16.810615+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:30:16.810615+0000","last_undegraded":"2024-04-26T07:30:16.810615+0000","last_fullsized":"2024-04-26T07:30:16.810615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.810615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.538993+0000","last_change":"2024-04-26T07:30:32.539075+0000","last_active":"2024-04-26T07:30:32.538993+0000","last_peered":"2024-04-26T07:30:32.538993+0000","last_clean":"2024-04-26T07:30:32.538993+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:30:32.538993+0000","last_undegraded":"2024-04-26T07:30:32.538993+0000","last_fullsized":"2024-04-26T07:30:32.538993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.538992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:28.602216+0000","last_change":"2024-04-26T07:30:28.602296+0000","last_active":"2024-04-26T07:30:28.602216+0000","last_peered":"2024-04-26T07:30:28.602216+0000","last_clean":"2024-04-26T07:30:28.602216+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:30:28.602216+0000","last_undegraded":"2024-04-26T07:30:28.602216+0000","last_fullsized":"2024-04-26T07:30:28.602216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_clean_scrub_stamp":"2024-04-26T07:30:28.602216+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.818279+0000","last_change":"2024-04-26T07:30:11.818359+0000","last_active":"2024-04-26T07:30:11.818279+0000","last_peered":"2024-04-26T07:30:11.818279+0000","last_clean":"2024-04-26T07:30:11.818279+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:30:11.818279+0000","last_undegraded":"2024-04-26T07:30:11.818279+0000","last_fullsized":"2024-04-26T07:30:11.818279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.818278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137320+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:32.137320+0000","last_peered":"2024-04-26T07:28:32.137320+0000","last_clean":"2024-04-26T07:28:32.137320+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:32.137320+0000","last_undegraded":"2024-04-26T07:28:32.137320+0000","last_fullsized":"2024-04-26T07:28:32.137320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:17.377065+0000","last_change":"2024-04-26T07:30:17.377162+0000","last_active":"2024-04-26T07:30:17.377065+0000","last_peered":"2024-04-26T07:30:17.377065+0000","last_clean":"2024-04-26T07:30:17.377065+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:30:17.377065+0000","last_undegraded":"2024-04-26T07:30:17.377065+0000","last_fullsized":"2024-04-26T07:30:17.377065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_clean_scrub_stamp":"2024-04-26T07:30:17.377064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.414289+0000","last_change":"2024-04-26T07:30:11.414367+0000","last_active":"2024-04-26T07:30:11.414289+0000","last_peered":"2024-04-26T07:30:11.414289+0000","last_clean":"2024-04-26T07:30:11.414289+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:30:11.414289+0000","last_undegraded":"2024-04-26T07:30:11.414289+0000","last_fullsized":"2024-04-26T07:30:11.414289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.414288+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:19.136227+0000","last_change":"2024-04-26T07:30:19.136319+0000","last_active":"2024-04-26T07:30:19.136227+0000","last_peered":"2024-04-26T07:30:19.136227+0000","last_clean":"2024-04-26T07:30:19.136227+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:30:19.136227+0000","last_undegraded":"2024-04-26T07:30:19.136227+0000","last_fullsized":"2024-04-26T07:30:19.136227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:19.136226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'12","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:29.574126+0000","last_change":"2024-04-26T07:30:29.574207+0000","last_active":"2024-04-26T07:30:29.574126+0000","last_peered":"2024-04-26T07:30:29.574126+0000","last_clean":"2024-04-26T07:30:29.574126+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:30:29.574126+0000","last_undegraded":"2024-04-26T07:30:29.574126+0000","last_fullsized":"2024-04-26T07:30:29.574126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_clean_scrub_stamp":"2024-04-26T07:30:29.574125+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:39.295620+0000","last_change":"2024-04-26T07:30:39.295711+0000","last_active":"2024-04-26T07:30:39.295620+0000","last_peered":"2024-04-26T07:30:39.295620+0000","last_clean":"2024-04-26T07:30:39.295620+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:30:39.295620+0000","last_undegraded":"2024-04-26T07:30:39.295620+0000","last_fullsized":"2024-04-26T07:30:39.295620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_clean_scrub_stamp":"2024-04-26T07:30:39.295619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.788374+0000","last_change":"2024-04-26T07:30:27.788453+0000","last_active":"2024-04-26T07:30:27.788374+0000","last_peered":"2024-04-26T07:30:27.788374+0000","last_clean":"2024-04-26T07:30:27.788374+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:30:27.788374+0000","last_undegraded":"2024-04-26T07:30:27.788374+0000","last_fullsized":"2024-04-26T07:30:27.788374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.788374+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:36.226727+0000","last_change":"2024-04-26T07:30:36.226816+0000","last_active":"2024-04-26T07:30:36.226727+0000","last_peered":"2024-04-26T07:30:36.226727+0000","last_clean":"2024-04-26T07:30:36.226727+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:30:36.226727+0000","last_undegraded":"2024-04-26T07:30:36.226727+0000","last_fullsized":"2024-04-26T07:30:36.226727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_clean_scrub_stamp":"2024-04-26T07:30:36.226726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140429+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:32.140429+0000","last_peered":"2024-04-26T07:28:32.140429+0000","last_clean":"2024-04-26T07:28:32.140429+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:32.140429+0000","last_undegraded":"2024-04-26T07:28:32.140429+0000","last_fullsized":"2024-04-26T07:28:32.140429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.249230+0000","last_change":"2024-04-26T07:30:32.249320+0000","last_active":"2024-04-26T07:30:32.249230+0000","last_peered":"2024-04-26T07:30:32.249230+0000","last_clean":"2024-04-26T07:30:32.249230+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:30:32.249230+0000","last_undegraded":"2024-04-26T07:30:32.249230+0000","last_fullsized":"2024-04-26T07:30:32.249230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.249230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138254+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:32.138254+0000","last_peered":"2024-04-26T07:28:32.138254+0000","last_clean":"2024-04-26T07:28:32.138254+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:32.138254+0000","last_undegraded":"2024-04-26T07:28:32.138254+0000","last_fullsized":"2024-04-26T07:28:32.138254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.561764+0000","last_change":"2024-04-26T07:30:31.561845+0000","last_active":"2024-04-26T07:30:31.561764+0000","last_peered":"2024-04-26T07:30:31.561764+0000","last_clean":"2024-04-26T07:30:31.561764+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:30:31.561764+0000","last_undegraded":"2024-04-26T07:30:31.561764+0000","last_fullsized":"2024-04-26T07:30:31.561764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.561764+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.216511+0000","last_change":"2024-04-26T07:30:31.216609+0000","last_active":"2024-04-26T07:30:31.216511+0000","last_peered":"2024-04-26T07:30:31.216511+0000","last_clean":"2024-04-26T07:30:31.216511+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:30:31.216511+0000","last_undegraded":"2024-04-26T07:30:31.216511+0000","last_fullsized":"2024-04-26T07:30:31.216511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.216510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.967952+0000","last_change":"2024-04-26T07:30:44.968081+0000","last_active":"2024-04-26T07:30:44.967952+0000","last_peered":"2024-04-26T07:30:44.967952+0000","last_clean":"2024-04-26T07:30:44.967952+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:30:44.967952+0000","last_undegraded":"2024-04-26T07:30:44.967952+0000","last_fullsized":"2024-04-26T07:30:44.967952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.967951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143246+0000","last_change":"2024-04-26T07:28:31.165612+0000","last_active":"2024-04-26T07:28:32.143246+0000","last_peered":"2024-04-26T07:28:32.143246+0000","last_clean":"2024-04-26T07:28:32.143246+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:28:32.143246+0000","last_undegraded":"2024-04-26T07:28:32.143246+0000","last_fullsized":"2024-04-26T07:28:32.143246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:46.936609+0000","last_change":"2024-04-26T07:30:46.936704+0000","last_active":"2024-04-26T07:30:46.936609+0000","last_peered":"2024-04-26T07:30:46.936609+0000","last_clean":"2024-04-26T07:30:46.936609+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:30:46.936609+0000","last_undegraded":"2024-04-26T07:30:46.936609+0000","last_fullsized":"2024-04-26T07:30:46.936609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_clean_scrub_stamp":"2024-04-26T07:30:46.936608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705696,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.27000000000000002,"15min":0.26700000000000002},"min":{"1min":0.20200000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.313,"5min":0.30099999999999999,"15min":0.29899999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.23100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.309,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.25600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.498},{"interface":"front","average":{"1min":0.314,"5min":0.312,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.54700000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705697,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.20999999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.30399999999999999,"15min":0.30599999999999999},"min":{"1min":0.20000000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.38800000000000001,"5min":0.442,"15min":0.442},"last":0.28599999999999998}]},{"osd":1,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.29699999999999999,"15min":0.29799999999999999},"min":{"1min":0.183,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.40999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.309,"5min":0.317,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32600000000000001,"15min":0.32800000000000001},"min":{"1min":0.221,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47799999999999998,"5min":0.503,"15min":0.503},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.32800000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.26700000000000002},"min":{"1min":0.189,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28799999999999998},"min":{"1min":0.20300000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.433}]},{"osd":2,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.313,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.311,"15min":0.309},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.312},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.313},"min":{"1min":0.23599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.45000000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.29899999999999999,"15min":0.29799999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.318},"min":{"1min":0.218,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.23100000000000001}]},{"osd":2,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.33200000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50600000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.26900000000000002}]}]}]}} 2024-04-26T07:30:49.201 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.202 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.202 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.202 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.202 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.202 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.203 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.203 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.203 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.203 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.203 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.203 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.204 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.204 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.204 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.204 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.205 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.205 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.205 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.205 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.205 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.205 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.206 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.206 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.206 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.206 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.206 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.206 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.207 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.207 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.207 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.207 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.207 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.208 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.208 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.208 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.208 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.208 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.209 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.209 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.209 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.209 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.210 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.210 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.210 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.210 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.210 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:30:49.210 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:31:09.212 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:31:09.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.331+0000 7f5c1c6d7700 1 Processor -- start 2024-04-26T07:31:09.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.331+0000 7f5c1c6d7700 1 -- start start 2024-04-26T07:31:09.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c1c6d7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c1406c990 0x7f5c14136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c1c6d7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c140648b0 0x7f5c14136c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c1c6d7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1406cd70 con 0x7f5c14133340 2024-04-26T07:31:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c1c6d7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c14132eb0 con 0x7f5c140648b0 2024-04-26T07:31:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c1c6d7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14063c00 con 0x7f5c1406c990 2024-04-26T07:31:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c1a473700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c1406c990 0x7f5c14136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c19c72700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c140648b0 0x7f5c14136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c1a473700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c1406c990 0x7f5c14136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:36382/0 (socket says 172.21.15.31:36382) 2024-04-26T07:31:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c1a473700 1 -- 172.21.15.31:0/2164542124 learned_addr learned my addr 172.21.15.31:0/2164542124 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:31:09.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.332+0000 7f5c19c72700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c140648b0 0x7f5c14136c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43650/0 (socket says 172.21.15.31:43650) 2024-04-26T07:31:09.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c1a473700 1 -- 172.21.15.31:0/2164542124 >> v2:172.21.15.31:3300/0 conn(0x7f5c140648b0 msgr2=0x7f5c14136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:31:09.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c1a473700 1 --2- 172.21.15.31:0/2164542124 >> v2:172.21.15.31:3300/0 conn(0x7f5c140648b0 0x7f5c14136c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:09.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c1a473700 1 -- 172.21.15.31:0/2164542124 >> v1:172.21.15.31:6789/0 conn(0x7f5c14133340 legacy=0x7f5c141337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:09.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c1a473700 1 -- 172.21.15.31:0/2164542124 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c141330a0 con 0x7f5c1406c990 2024-04-26T07:31:09.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c19c72700 1 --2- 172.21.15.31:0/2164542124 >> v2:172.21.15.31:3300/0 conn(0x7f5c140648b0 0x7f5c14136c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:31:09.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c1a473700 1 --2- 172.21.15.31:0/2164542124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c1406c990 0x7f5c14136400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5c140a9bc0 tx=0x7f5c08006eb0).ready entity=mon.1 client_cookie=7fbcae7879d3e39a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:31:09.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c19471700 1 -- 172.21.15.31:0/2164542124 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0800d5c0 con 0x7f5c1406c990 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c19471700 1 -- 172.21.15.31:0/2164542124 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c08000e90 con 0x7f5c1406c990 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c19471700 1 -- 172.21.15.31:0/2164542124 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0800d950 con 0x7f5c1406c990 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/2164542124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c1406c990 msgr2=0x7f5c14136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.333+0000 7f5c1c6d7700 1 --2- 172.21.15.31:0/2164542124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c1406c990 0x7f5c14136400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5c140a9bc0 tx=0x7f5c08006eb0).stop 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.334+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/2164542124 shutdown_connections 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.334+0000 7f5c1c6d7700 1 --2- 172.21.15.31:0/2164542124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c1406c990 0x7f5c14136400 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.334+0000 7f5c1c6d7700 1 --2- 172.21.15.31:0/2164542124 >> v2:172.21.15.31:3300/0 conn(0x7f5c140648b0 0x7f5c14136c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.334+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/2164542124 >> 172.21.15.31:0/2164542124 conn(0x7f5c14061370 msgr2=0x7f5c1406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:31:09.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.334+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/2164542124 shutdown_connections 2024-04-26T07:31:09.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.334+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/2164542124 wait complete. 2024-04-26T07:31:09.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.334+0000 7f5c1c6d7700 1 Processor -- start 2024-04-26T07:31:09.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.334+0000 7f5c1c6d7700 1 -- start start 2024-04-26T07:31:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1c6d7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c140648b0 0x7f5c1409d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1c6d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c1406c990 0x7f5c14067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1c6d7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c14133340 0x7f5c14096320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1c6d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14098ce0 con 0x7f5c1406c990 2024-04-26T07:31:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1c6d7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1409e890 con 0x7f5c140648b0 2024-04-26T07:31:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1c6d7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1409eb50 con 0x7f5c14133340 2024-04-26T07:31:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c19c72700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c1406c990 0x7f5c14067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:09.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1a473700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c140648b0 0x7f5c1409d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:09.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c19c72700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c1406c990 0x7f5c14067ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43664/0 (socket says 172.21.15.31:43664) 2024-04-26T07:31:09.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c19c72700 1 -- 172.21.15.31:0/1007482518 learned_addr learned my addr 172.21.15.31:0/1007482518 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:31:09.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1ac74700 1 --2- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c14133340 0x7f5c14096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:09.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1a473700 1 -- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c14133340 msgr2=0x7f5c14096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:09.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1a473700 1 --2- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c14133340 0x7f5c14096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:09.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1a473700 1 -- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c1406c990 msgr2=0x7f5c14067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:09.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1a473700 1 --2- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c1406c990 0x7f5c14067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.335+0000 7f5c1a473700 1 -- 172.21.15.31:0/1007482518 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1000d410 con 0x7f5c140648b0 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.336+0000 7f5c1a473700 1 --2- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c140648b0 0x7f5c1409d2e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5c140a9bc0 tx=0x7f5c08015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.336+0000 7f5c077fe700 1 -- 172.21.15.31:0/1007482518 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c08021070 con 0x7f5c140648b0 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.336+0000 7f5c077fe700 1 -- 172.21.15.31:0/1007482518 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c08011760 con 0x7f5c140648b0 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.336+0000 7f5c077fe700 1 -- 172.21.15.31:0/1007482518 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c08011ac0 con 0x7f5c140648b0 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.336+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0800b1e0 con 0x7f5c140648b0 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.336+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c14068090 con 0x7f5c140648b0 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.337+0000 7f5c077fe700 1 -- 172.21.15.31:0/1007482518 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5c0800f070 con 0x7f5c140648b0 2024-04-26T07:31:09.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.337+0000 7f5c077fe700 1 -- 172.21.15.31:0/1007482518 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5c0804b740 con 0x7f5c140648b0 2024-04-26T07:31:09.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.337+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1406bbc0 con 0x7f5c140648b0 2024-04-26T07:31:09.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.340+0000 7f5c077fe700 1 -- 172.21.15.31:0/1007482518 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5c08008630 con 0x7f5c140648b0 2024-04-26T07:31:09.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.452+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c140a9ec0 con 0x7f5bf4038f80 2024-04-26T07:31:09.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.459+0000 7f5c077fe700 1 -- 172.21.15.31:0/1007482518 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252209 (unknown 2965378022 0 2382981938) 0x7f5c140a9ec0 con 0x7f5bf4038f80 2024-04-26T07:31:09.462 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:31:09.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 >> v1:172.21.15.31:6816/39613 conn(0x7f5bf4038f80 legacy=0x7f5bf403b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:09.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c140648b0 msgr2=0x7f5c1409d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:09.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 --2- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c140648b0 0x7f5c1409d2e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5c140a9bc0 tx=0x7f5c08015000).stop 2024-04-26T07:31:09.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 shutdown_connections 2024-04-26T07:31:09.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 --2- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5c14133340 0x7f5c14096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:09.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 --2- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c140648b0 0x7f5c1409d2e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:09.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 --2- 172.21.15.31:0/1007482518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c1406c990 0x7f5c14067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:09.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 >> 172.21.15.31:0/1007482518 conn(0x7f5c14061370 msgr2=0x7f5c1409af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:31:09.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 shutdown_connections 2024-04-26T07:31:09.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:09.461+0000 7f5c1c6d7700 1 -- 172.21.15.31:0/1007482518 wait complete. 2024-04-26T07:31:09.465 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:31:09.471 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-04-26T07:31:08.010737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13536,"num_omap_keys":21,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002991"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.426802+0000","last_change":"2024-04-26T07:30:52.426911+0000","last_active":"2024-04-26T07:30:52.426802+0000","last_peered":"2024-04-26T07:30:52.426802+0000","last_clean":"2024-04-26T07:30:52.426802+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:30:52.426802+0000","last_undegraded":"2024-04-26T07:30:52.426802+0000","last_fullsized":"2024-04-26T07:30:52.426802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.426801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.387022+0000","last_change":"2024-04-26T07:30:51.387112+0000","last_active":"2024-04-26T07:30:51.387022+0000","last_peered":"2024-04-26T07:30:51.387022+0000","last_clean":"2024-04-26T07:30:51.387022+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:30:51.387022+0000","last_undegraded":"2024-04-26T07:30:51.387022+0000","last_fullsized":"2024-04-26T07:30:51.387022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.387021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143288+0000","last_change":"2024-04-26T07:28:31.186409+0000","last_active":"2024-04-26T07:28:32.143288+0000","last_peered":"2024-04-26T07:28:32.143288+0000","last_clean":"2024-04-26T07:28:32.143288+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:28:32.143288+0000","last_undegraded":"2024-04-26T07:28:32.143288+0000","last_fullsized":"2024-04-26T07:28:32.143288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143164+0000","last_change":"2024-04-26T07:28:31.186401+0000","last_active":"2024-04-26T07:28:32.143164+0000","last_peered":"2024-04-26T07:28:32.143164+0000","last_clean":"2024-04-26T07:28:32.143164+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:28:32.143164+0000","last_undegraded":"2024-04-26T07:28:32.143164+0000","last_fullsized":"2024-04-26T07:28:32.143164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142620+0000","last_change":"2024-04-26T07:28:31.168771+0000","last_active":"2024-04-26T07:28:32.142620+0000","last_peered":"2024-04-26T07:28:32.142620+0000","last_clean":"2024-04-26T07:28:32.142620+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:28:32.142620+0000","last_undegraded":"2024-04-26T07:28:32.142620+0000","last_fullsized":"2024-04-26T07:28:32.142620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137729+0000","last_change":"2024-04-26T07:28:31.179601+0000","last_active":"2024-04-26T07:28:32.137729+0000","last_peered":"2024-04-26T07:28:32.137729+0000","last_clean":"2024-04-26T07:28:32.137729+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:28:32.137729+0000","last_undegraded":"2024-04-26T07:28:32.137729+0000","last_fullsized":"2024-04-26T07:28:32.137729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.143368+0000","last_change":"2024-04-26T07:28:31.169978+0000","last_active":"2024-04-26T07:28:32.143368+0000","last_peered":"2024-04-26T07:28:32.143368+0000","last_clean":"2024-04-26T07:28:32.143368+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:28:32.143368+0000","last_undegraded":"2024-04-26T07:28:32.143368+0000","last_fullsized":"2024-04-26T07:28:32.143368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.047204+0000","last_change":"2024-04-26T07:31:06.047291+0000","last_active":"2024-04-26T07:31:06.047204+0000","last_peered":"2024-04-26T07:31:06.047204+0000","last_clean":"2024-04-26T07:31:06.047204+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:31:06.047204+0000","last_undegraded":"2024-04-26T07:31:06.047204+0000","last_fullsized":"2024-04-26T07:31:06.047204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.047203+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:04.079986+0000","last_change":"2024-04-26T07:31:04.080077+0000","last_active":"2024-04-26T07:31:04.079986+0000","last_peered":"2024-04-26T07:31:04.079986+0000","last_clean":"2024-04-26T07:31:04.079986+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:31:04.079986+0000","last_undegraded":"2024-04-26T07:31:04.079986+0000","last_fullsized":"2024-04-26T07:31:04.079986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_clean_scrub_stamp":"2024-04-26T07:31:04.079985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:47.333000+0000","last_change":"2024-04-26T07:30:47.333131+0000","last_active":"2024-04-26T07:30:47.333000+0000","last_peered":"2024-04-26T07:30:47.333000+0000","last_clean":"2024-04-26T07:30:47.333000+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:30:47.333000+0000","last_undegraded":"2024-04-26T07:30:47.333000+0000","last_fullsized":"2024-04-26T07:30:47.333000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_clean_scrub_stamp":"2024-04-26T07:30:47.333000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.307226+0000","last_change":"2024-04-26T07:30:42.307331+0000","last_active":"2024-04-26T07:30:42.307226+0000","last_peered":"2024-04-26T07:30:42.307226+0000","last_clean":"2024-04-26T07:30:42.307226+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:30:42.307226+0000","last_undegraded":"2024-04-26T07:30:42.307226+0000","last_fullsized":"2024-04-26T07:30:42.307226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.307226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:00.092689+0000","last_change":"2024-04-26T07:31:00.092776+0000","last_active":"2024-04-26T07:31:00.092689+0000","last_peered":"2024-04-26T07:31:00.092689+0000","last_clean":"2024-04-26T07:31:00.092689+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:31:00.092689+0000","last_undegraded":"2024-04-26T07:31:00.092689+0000","last_fullsized":"2024-04-26T07:31:00.092689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_clean_scrub_stamp":"2024-04-26T07:31:00.092689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.142710+0000","last_change":"2024-04-26T07:28:31.186472+0000","last_active":"2024-04-26T07:28:32.142710+0000","last_peered":"2024-04-26T07:28:32.142710+0000","last_clean":"2024-04-26T07:28:32.142710+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:28:32.142710+0000","last_undegraded":"2024-04-26T07:28:32.142710+0000","last_fullsized":"2024-04-26T07:28:32.142710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.307189+0000","last_change":"2024-04-26T07:31:06.307276+0000","last_active":"2024-04-26T07:31:06.307189+0000","last_peered":"2024-04-26T07:31:06.307189+0000","last_clean":"2024-04-26T07:31:06.307189+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:31:06.307189+0000","last_undegraded":"2024-04-26T07:31:06.307189+0000","last_fullsized":"2024-04-26T07:31:06.307189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.307188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:59.385202+0000","last_change":"2024-04-26T07:30:59.385291+0000","last_active":"2024-04-26T07:30:59.385202+0000","last_peered":"2024-04-26T07:30:59.385202+0000","last_clean":"2024-04-26T07:30:59.385202+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:30:59.385202+0000","last_undegraded":"2024-04-26T07:30:59.385202+0000","last_fullsized":"2024-04-26T07:30:59.385202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_clean_scrub_stamp":"2024-04-26T07:30:59.385201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:40.294718+0000","last_change":"2024-04-26T07:30:40.294811+0000","last_active":"2024-04-26T07:30:40.294718+0000","last_peered":"2024-04-26T07:30:40.294718+0000","last_clean":"2024-04-26T07:30:40.294718+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:30:40.294718+0000","last_undegraded":"2024-04-26T07:30:40.294718+0000","last_fullsized":"2024-04-26T07:30:40.294718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_clean_scrub_stamp":"2024-04-26T07:30:40.294717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.022023+0000","last_change":"2024-04-26T07:30:56.022116+0000","last_active":"2024-04-26T07:30:56.022023+0000","last_peered":"2024-04-26T07:30:56.022023+0000","last_clean":"2024-04-26T07:30:56.022023+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:30:56.022023+0000","last_undegraded":"2024-04-26T07:30:56.022023+0000","last_fullsized":"2024-04-26T07:30:56.022023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.022022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:55.027604+0000","last_change":"2024-04-26T07:30:55.027705+0000","last_active":"2024-04-26T07:30:55.027604+0000","last_peered":"2024-04-26T07:30:55.027604+0000","last_clean":"2024-04-26T07:30:55.027604+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:30:55.027604+0000","last_undegraded":"2024-04-26T07:30:55.027604+0000","last_fullsized":"2024-04-26T07:30:55.027604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_clean_scrub_stamp":"2024-04-26T07:30:55.027603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.447536+0000","last_change":"2024-04-26T07:30:52.447634+0000","last_active":"2024-04-26T07:30:52.447536+0000","last_peered":"2024-04-26T07:30:52.447536+0000","last_clean":"2024-04-26T07:30:52.447536+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:30:52.447536+0000","last_undegraded":"2024-04-26T07:30:52.447536+0000","last_fullsized":"2024-04-26T07:30:52.447536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.447536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:54.059185+0000","last_change":"2024-04-26T07:30:54.059310+0000","last_active":"2024-04-26T07:30:54.059185+0000","last_peered":"2024-04-26T07:30:54.059185+0000","last_clean":"2024-04-26T07:30:54.059185+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:30:54.059185+0000","last_undegraded":"2024-04-26T07:30:54.059185+0000","last_fullsized":"2024-04-26T07:30:54.059185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_clean_scrub_stamp":"2024-04-26T07:30:54.059185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:53.020287+0000","last_change":"2024-04-26T07:30:53.020393+0000","last_active":"2024-04-26T07:30:53.020287+0000","last_peered":"2024-04-26T07:30:53.020287+0000","last_clean":"2024-04-26T07:30:53.020287+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:30:53.020287+0000","last_undegraded":"2024-04-26T07:30:53.020287+0000","last_fullsized":"2024-04-26T07:30:53.020287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_clean_scrub_stamp":"2024-04-26T07:30:53.020286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.976317+0000","last_change":"2024-04-26T07:30:50.976414+0000","last_active":"2024-04-26T07:30:50.976317+0000","last_peered":"2024-04-26T07:30:50.976317+0000","last_clean":"2024-04-26T07:30:50.976317+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:30:50.976317+0000","last_undegraded":"2024-04-26T07:30:50.976317+0000","last_fullsized":"2024-04-26T07:30:50.976317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.976316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.890710+0000","last_change":"2024-04-26T07:30:23.890791+0000","last_active":"2024-04-26T07:30:23.890710+0000","last_peered":"2024-04-26T07:30:23.890710+0000","last_clean":"2024-04-26T07:30:23.890710+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:30:23.890710+0000","last_undegraded":"2024-04-26T07:30:23.890710+0000","last_fullsized":"2024-04-26T07:30:23.890710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.890710+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:22.844919+0000","last_change":"2024-04-26T07:30:22.845011+0000","last_active":"2024-04-26T07:30:22.844919+0000","last_peered":"2024-04-26T07:30:22.844919+0000","last_clean":"2024-04-26T07:30:22.844919+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:30:22.844919+0000","last_undegraded":"2024-04-26T07:30:22.844919+0000","last_fullsized":"2024-04-26T07:30:22.844919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_clean_scrub_stamp":"2024-04-26T07:30:22.844919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.440808+0000","last_change":"2024-04-26T07:30:44.440891+0000","last_active":"2024-04-26T07:30:44.440808+0000","last_peered":"2024-04-26T07:30:44.440808+0000","last_clean":"2024-04-26T07:30:44.440808+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:30:44.440808+0000","last_undegraded":"2024-04-26T07:30:44.440808+0000","last_fullsized":"2024-04-26T07:30:44.440808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.440807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:33.847320+0000","last_change":"2024-04-26T07:28:30.851226+0000","last_active":"2024-04-26T07:28:33.847320+0000","last_peered":"2024-04-26T07:28:33.847320+0000","last_clean":"2024-04-26T07:28:33.847320+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:28:33.847320+0000","last_undegraded":"2024-04-26T07:28:33.847320+0000","last_fullsized":"2024-04-26T07:28:33.847320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'9","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.580238+0000","last_change":"2024-04-26T07:30:25.580325+0000","last_active":"2024-04-26T07:30:25.580238+0000","last_peered":"2024-04-26T07:30:25.580238+0000","last_clean":"2024-04-26T07:30:25.580238+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:30:25.580238+0000","last_undegraded":"2024-04-26T07:30:25.580238+0000","last_fullsized":"2024-04-26T07:30:25.580238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'9","last_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_deep_scrub":"19'9","last_deep_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.580237+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137664+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:32.137664+0000","last_peered":"2024-04-26T07:28:32.137664+0000","last_clean":"2024-04-26T07:28:32.137664+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:32.137664+0000","last_undegraded":"2024-04-26T07:28:32.137664+0000","last_fullsized":"2024-04-26T07:28:32.137664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.163184+0000","last_change":"2024-04-26T07:30:15.163266+0000","last_active":"2024-04-26T07:30:15.163184+0000","last_peered":"2024-04-26T07:30:15.163184+0000","last_clean":"2024-04-26T07:30:15.163184+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:30:15.163184+0000","last_undegraded":"2024-04-26T07:30:15.163184+0000","last_fullsized":"2024-04-26T07:30:15.163184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.163183+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138363+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:32.138363+0000","last_peered":"2024-04-26T07:28:32.138363+0000","last_clean":"2024-04-26T07:28:32.138363+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:32.138363+0000","last_undegraded":"2024-04-26T07:28:32.138363+0000","last_fullsized":"2024-04-26T07:28:32.138363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.570415+0000","last_change":"2024-04-26T07:30:23.570499+0000","last_active":"2024-04-26T07:30:23.570415+0000","last_peered":"2024-04-26T07:30:23.570415+0000","last_clean":"2024-04-26T07:30:23.570415+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:30:23.570415+0000","last_undegraded":"2024-04-26T07:30:23.570415+0000","last_fullsized":"2024-04-26T07:30:23.570415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.570415+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.011724+0000","last_change":"2024-04-26T07:30:44.011821+0000","last_active":"2024-04-26T07:30:44.011724+0000","last_peered":"2024-04-26T07:30:44.011724+0000","last_clean":"2024-04-26T07:30:44.011724+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:30:44.011724+0000","last_undegraded":"2024-04-26T07:30:44.011724+0000","last_fullsized":"2024-04-26T07:30:44.011724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.011723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'21","reported_seq":35,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:07.012832+0000","last_change":"2024-04-26T07:31:07.012911+0000","last_active":"2024-04-26T07:31:07.012832+0000","last_peered":"2024-04-26T07:31:07.012832+0000","last_clean":"2024-04-26T07:31:07.012832+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:31:07.012832+0000","last_undegraded":"2024-04-26T07:31:07.012832+0000","last_fullsized":"2024-04-26T07:31:07.012832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'21","last_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_deep_scrub":"19'21","last_deep_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_clean_scrub_stamp":"2024-04-26T07:31:07.012831+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.232011+0000","last_change":"2024-04-26T07:30:27.232105+0000","last_active":"2024-04-26T07:30:27.232011+0000","last_peered":"2024-04-26T07:30:27.232011+0000","last_clean":"2024-04-26T07:30:27.232011+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:30:27.232011+0000","last_undegraded":"2024-04-26T07:30:27.232011+0000","last_fullsized":"2024-04-26T07:30:27.232011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.232010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:01.928484+0000","last_change":"2024-04-26T07:31:01.928571+0000","last_active":"2024-04-26T07:31:01.928484+0000","last_peered":"2024-04-26T07:31:01.928484+0000","last_clean":"2024-04-26T07:31:01.928484+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:31:01.928484+0000","last_undegraded":"2024-04-26T07:31:01.928484+0000","last_fullsized":"2024-04-26T07:31:01.928484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_clean_scrub_stamp":"2024-04-26T07:31:01.928484+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137836+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:32.137836+0000","last_peered":"2024-04-26T07:28:32.137836+0000","last_clean":"2024-04-26T07:28:32.137836+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:32.137836+0000","last_undegraded":"2024-04-26T07:28:32.137836+0000","last_fullsized":"2024-04-26T07:28:32.137836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:21.505390+0000","last_change":"2024-04-26T07:30:21.505470+0000","last_active":"2024-04-26T07:30:21.505390+0000","last_peered":"2024-04-26T07:30:21.505390+0000","last_clean":"2024-04-26T07:30:21.505390+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:30:21.505390+0000","last_undegraded":"2024-04-26T07:30:21.505390+0000","last_fullsized":"2024-04-26T07:30:21.505390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_clean_scrub_stamp":"2024-04-26T07:30:21.505390+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139915+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:32.139915+0000","last_peered":"2024-04-26T07:28:32.139915+0000","last_clean":"2024-04-26T07:28:32.139915+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:32.139915+0000","last_undegraded":"2024-04-26T07:28:32.139915+0000","last_fullsized":"2024-04-26T07:28:32.139915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.845651+0000","last_change":"2024-04-26T07:30:56.845747+0000","last_active":"2024-04-26T07:30:56.845651+0000","last_peered":"2024-04-26T07:30:56.845651+0000","last_clean":"2024-04-26T07:30:56.845651+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:30:56.845651+0000","last_undegraded":"2024-04-26T07:30:56.845651+0000","last_fullsized":"2024-04-26T07:30:56.845651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.845650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.427936+0000","last_change":"2024-04-26T07:30:42.428022+0000","last_active":"2024-04-26T07:30:42.427936+0000","last_peered":"2024-04-26T07:30:42.427936+0000","last_clean":"2024-04-26T07:30:42.427936+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:30:42.427936+0000","last_undegraded":"2024-04-26T07:30:42.427936+0000","last_fullsized":"2024-04-26T07:30:42.427936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.427935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'15","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:18.834721+0000","last_change":"2024-04-26T07:30:18.834800+0000","last_active":"2024-04-26T07:30:18.834721+0000","last_peered":"2024-04-26T07:30:18.834721+0000","last_clean":"2024-04-26T07:30:18.834721+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:30:18.834721+0000","last_undegraded":"2024-04-26T07:30:18.834721+0000","last_fullsized":"2024-04-26T07:30:18.834721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'15","last_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_deep_scrub":"19'15","last_deep_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_clean_scrub_stamp":"2024-04-26T07:30:18.834720+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139763+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:32.139763+0000","last_peered":"2024-04-26T07:28:32.139763+0000","last_clean":"2024-04-26T07:28:32.139763+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:32.139763+0000","last_undegraded":"2024-04-26T07:28:32.139763+0000","last_fullsized":"2024-04-26T07:28:32.139763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.546240+0000","last_change":"2024-04-26T07:30:20.546354+0000","last_active":"2024-04-26T07:30:20.546240+0000","last_peered":"2024-04-26T07:30:20.546240+0000","last_clean":"2024-04-26T07:30:20.546240+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:30:20.546240+0000","last_undegraded":"2024-04-26T07:30:20.546240+0000","last_fullsized":"2024-04-26T07:30:20.546240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.546239+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137801+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:32.137801+0000","last_peered":"2024-04-26T07:28:32.137801+0000","last_clean":"2024-04-26T07:28:32.137801+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:32.137801+0000","last_undegraded":"2024-04-26T07:28:32.137801+0000","last_fullsized":"2024-04-26T07:28:32.137801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:13.068833+0000","last_change":"2024-04-26T07:30:13.068913+0000","last_active":"2024-04-26T07:30:13.068833+0000","last_peered":"2024-04-26T07:30:13.068833+0000","last_clean":"2024-04-26T07:30:13.068833+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:30:13.068833+0000","last_undegraded":"2024-04-26T07:30:13.068833+0000","last_fullsized":"2024-04-26T07:30:13.068833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:13.068832+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.955449+0000","last_change":"2024-04-26T07:30:38.955557+0000","last_active":"2024-04-26T07:30:38.955449+0000","last_peered":"2024-04-26T07:30:38.955449+0000","last_clean":"2024-04-26T07:30:38.955449+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:30:38.955449+0000","last_undegraded":"2024-04-26T07:30:38.955449+0000","last_fullsized":"2024-04-26T07:30:38.955449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.955449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.700832+0000","last_change":"2024-04-26T07:30:51.700910+0000","last_active":"2024-04-26T07:30:51.700832+0000","last_peered":"2024-04-26T07:30:51.700832+0000","last_clean":"2024-04-26T07:30:51.700832+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:30:51.700832+0000","last_undegraded":"2024-04-26T07:30:51.700832+0000","last_fullsized":"2024-04-26T07:30:51.700832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.700832+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.148236+0000","last_change":"2024-04-26T07:30:20.148325+0000","last_active":"2024-04-26T07:30:20.148236+0000","last_peered":"2024-04-26T07:30:20.148236+0000","last_clean":"2024-04-26T07:30:20.148236+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:30:20.148236+0000","last_undegraded":"2024-04-26T07:30:20.148236+0000","last_fullsized":"2024-04-26T07:30:20.148236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.148235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.511807+0000","last_change":"2024-04-26T07:30:16.511900+0000","last_active":"2024-04-26T07:30:16.511807+0000","last_peered":"2024-04-26T07:30:16.511807+0000","last_clean":"2024-04-26T07:30:16.511807+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:30:16.511807+0000","last_undegraded":"2024-04-26T07:30:16.511807+0000","last_fullsized":"2024-04-26T07:30:16.511807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.511806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:34.479850+0000","last_change":"2024-04-26T07:30:34.479942+0000","last_active":"2024-04-26T07:30:34.479850+0000","last_peered":"2024-04-26T07:30:34.479850+0000","last_clean":"2024-04-26T07:30:34.479850+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:30:34.479850+0000","last_undegraded":"2024-04-26T07:30:34.479850+0000","last_fullsized":"2024-04-26T07:30:34.479850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_clean_scrub_stamp":"2024-04-26T07:30:34.479849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:49.675793+0000","last_change":"2024-04-26T07:30:49.675867+0000","last_active":"2024-04-26T07:30:49.675793+0000","last_peered":"2024-04-26T07:30:49.675793+0000","last_clean":"2024-04-26T07:30:49.675793+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:30:49.675793+0000","last_undegraded":"2024-04-26T07:30:49.675793+0000","last_fullsized":"2024-04-26T07:30:49.675793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_clean_scrub_stamp":"2024-04-26T07:30:49.675793+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.454434+0000","last_change":"2024-04-26T07:30:38.454554+0000","last_active":"2024-04-26T07:30:38.454434+0000","last_peered":"2024-04-26T07:30:38.454434+0000","last_clean":"2024-04-26T07:30:38.454434+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:30:38.454434+0000","last_undegraded":"2024-04-26T07:30:38.454434+0000","last_fullsized":"2024-04-26T07:30:38.454434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.454433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.698682+0000","last_change":"2024-04-26T07:30:42.698763+0000","last_active":"2024-04-26T07:30:42.698682+0000","last_peered":"2024-04-26T07:30:42.698682+0000","last_clean":"2024-04-26T07:30:42.698682+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:30:42.698682+0000","last_undegraded":"2024-04-26T07:30:42.698682+0000","last_fullsized":"2024-04-26T07:30:42.698682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.698682+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140027+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:32.140027+0000","last_peered":"2024-04-26T07:28:32.140027+0000","last_clean":"2024-04-26T07:28:32.140027+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:32.140027+0000","last_undegraded":"2024-04-26T07:28:32.140027+0000","last_fullsized":"2024-04-26T07:28:32.140027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:35.647109+0000","last_change":"2024-04-26T07:30:35.647193+0000","last_active":"2024-04-26T07:30:35.647109+0000","last_peered":"2024-04-26T07:30:35.647109+0000","last_clean":"2024-04-26T07:30:35.647109+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:30:35.647109+0000","last_undegraded":"2024-04-26T07:30:35.647109+0000","last_fullsized":"2024-04-26T07:30:35.647109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_clean_scrub_stamp":"2024-04-26T07:30:35.647108+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.207071+0000","last_change":"2024-04-26T07:30:25.207160+0000","last_active":"2024-04-26T07:30:25.207071+0000","last_peered":"2024-04-26T07:30:25.207071+0000","last_clean":"2024-04-26T07:30:25.207071+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:30:25.207071+0000","last_undegraded":"2024-04-26T07:30:25.207071+0000","last_fullsized":"2024-04-26T07:30:25.207071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.207070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.679673+0000","last_change":"2024-04-26T07:30:33.679748+0000","last_active":"2024-04-26T07:30:33.679673+0000","last_peered":"2024-04-26T07:30:33.679673+0000","last_clean":"2024-04-26T07:30:33.679673+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:30:33.679673+0000","last_undegraded":"2024-04-26T07:30:33.679673+0000","last_fullsized":"2024-04-26T07:30:33.679673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.679672+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:43.016723+0000","last_change":"2024-04-26T07:30:43.016816+0000","last_active":"2024-04-26T07:30:43.016723+0000","last_peered":"2024-04-26T07:30:43.016723+0000","last_clean":"2024-04-26T07:30:43.016723+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:30:43.016723+0000","last_undegraded":"2024-04-26T07:30:43.016723+0000","last_fullsized":"2024-04-26T07:30:43.016723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:43.016723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.867473+0000","last_change":"2024-04-26T07:30:09.867557+0000","last_active":"2024-04-26T07:30:09.867473+0000","last_peered":"2024-04-26T07:30:09.867473+0000","last_clean":"2024-04-26T07:30:09.867473+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:30:09.867473+0000","last_undegraded":"2024-04-26T07:30:09.867473+0000","last_fullsized":"2024-04-26T07:30:09.867473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.867473+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.023356+0000","last_change":"2024-04-26T07:30:11.023477+0000","last_active":"2024-04-26T07:30:11.023356+0000","last_peered":"2024-04-26T07:30:11.023356+0000","last_clean":"2024-04-26T07:30:11.023356+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:30:11.023356+0000","last_undegraded":"2024-04-26T07:30:11.023356+0000","last_fullsized":"2024-04-26T07:30:11.023356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.023356+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:30.811830+0000","last_change":"2024-04-26T07:30:30.811917+0000","last_active":"2024-04-26T07:30:30.811830+0000","last_peered":"2024-04-26T07:30:30.811830+0000","last_clean":"2024-04-26T07:30:30.811830+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:30:30.811830+0000","last_undegraded":"2024-04-26T07:30:30.811830+0000","last_fullsized":"2024-04-26T07:30:30.811830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_clean_scrub_stamp":"2024-04-26T07:30:30.811830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:14.491026+0000","last_change":"2024-04-26T07:30:14.491123+0000","last_active":"2024-04-26T07:30:14.491026+0000","last_peered":"2024-04-26T07:30:14.491026+0000","last_clean":"2024-04-26T07:30:14.491026+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:30:14.491026+0000","last_undegraded":"2024-04-26T07:30:14.491026+0000","last_fullsized":"2024-04-26T07:30:14.491026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_clean_scrub_stamp":"2024-04-26T07:30:14.491025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.413359+0000","last_change":"2024-04-26T07:30:09.413441+0000","last_active":"2024-04-26T07:30:09.413359+0000","last_peered":"2024-04-26T07:30:09.413359+0000","last_clean":"2024-04-26T07:30:09.413359+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:30:09.413359+0000","last_undegraded":"2024-04-26T07:30:09.413359+0000","last_fullsized":"2024-04-26T07:30:09.413359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.413358+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.849915+0000","last_change":"2024-04-26T07:30:31.850005+0000","last_active":"2024-04-26T07:30:31.849915+0000","last_peered":"2024-04-26T07:30:31.849915+0000","last_clean":"2024-04-26T07:30:31.849915+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:30:31.849915+0000","last_undegraded":"2024-04-26T07:30:31.849915+0000","last_fullsized":"2024-04-26T07:30:31.849915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.849914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.028509+0000","last_change":"2024-04-26T07:30:08.028621+0000","last_active":"2024-04-26T07:30:08.028509+0000","last_peered":"2024-04-26T07:30:08.028509+0000","last_clean":"2024-04-26T07:30:08.028509+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:30:08.028509+0000","last_undegraded":"2024-04-26T07:30:08.028509+0000","last_fullsized":"2024-04-26T07:30:08.028509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.028509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.809606+0000","last_change":"2024-04-26T07:30:12.809726+0000","last_active":"2024-04-26T07:30:12.809606+0000","last_peered":"2024-04-26T07:30:12.809606+0000","last_clean":"2024-04-26T07:30:12.809606+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:30:12.809606+0000","last_undegraded":"2024-04-26T07:30:12.809606+0000","last_fullsized":"2024-04-26T07:30:12.809606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.809605+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.923160+0000","last_change":"2024-04-26T07:30:33.923250+0000","last_active":"2024-04-26T07:30:33.923160+0000","last_peered":"2024-04-26T07:30:33.923160+0000","last_clean":"2024-04-26T07:30:33.923160+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:30:33.923160+0000","last_undegraded":"2024-04-26T07:30:33.923160+0000","last_fullsized":"2024-04-26T07:30:33.923160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.923160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.443421+0000","last_change":"2024-04-26T07:30:15.443501+0000","last_active":"2024-04-26T07:30:15.443421+0000","last_peered":"2024-04-26T07:30:15.443421+0000","last_clean":"2024-04-26T07:30:15.443421+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:30:15.443421+0000","last_undegraded":"2024-04-26T07:30:15.443421+0000","last_fullsized":"2024-04-26T07:30:15.443421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.443421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.891685+0000","last_change":"2024-04-26T07:30:08.891750+0000","last_active":"2024-04-26T07:30:08.891685+0000","last_peered":"2024-04-26T07:30:08.891685+0000","last_clean":"2024-04-26T07:30:08.891685+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:30:08.891685+0000","last_undegraded":"2024-04-26T07:30:08.891685+0000","last_fullsized":"2024-04-26T07:30:08.891685+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.891685+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.436730+0000","last_change":"2024-04-26T07:30:20.436817+0000","last_active":"2024-04-26T07:30:20.436730+0000","last_peered":"2024-04-26T07:30:20.436730+0000","last_clean":"2024-04-26T07:30:20.436730+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:30:20.436730+0000","last_undegraded":"2024-04-26T07:30:20.436730+0000","last_fullsized":"2024-04-26T07:30:20.436730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.436730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140556+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:32.140556+0000","last_peered":"2024-04-26T07:28:32.140556+0000","last_clean":"2024-04-26T07:28:32.140556+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:32.140556+0000","last_undegraded":"2024-04-26T07:28:32.140556+0000","last_fullsized":"2024-04-26T07:28:32.140556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.493074+0000","last_change":"2024-04-26T07:30:12.493165+0000","last_active":"2024-04-26T07:30:12.493074+0000","last_peered":"2024-04-26T07:30:12.493074+0000","last_clean":"2024-04-26T07:30:12.493074+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:30:12.493074+0000","last_undegraded":"2024-04-26T07:30:12.493074+0000","last_fullsized":"2024-04-26T07:30:12.493074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.493074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.440210+0000","last_change":"2024-04-26T07:30:08.440323+0000","last_active":"2024-04-26T07:30:08.440210+0000","last_peered":"2024-04-26T07:30:08.440210+0000","last_clean":"2024-04-26T07:30:08.440210+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:30:08.440210+0000","last_undegraded":"2024-04-26T07:30:08.440210+0000","last_fullsized":"2024-04-26T07:30:08.440210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.440209+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.503368+0000","last_change":"2024-04-26T07:30:33.503463+0000","last_active":"2024-04-26T07:30:33.503368+0000","last_peered":"2024-04-26T07:30:33.503368+0000","last_clean":"2024-04-26T07:30:33.503368+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:30:33.503368+0000","last_undegraded":"2024-04-26T07:30:33.503368+0000","last_fullsized":"2024-04-26T07:30:33.503368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.503367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.416586+0000","last_change":"2024-04-26T07:30:16.416716+0000","last_active":"2024-04-26T07:30:16.416586+0000","last_peered":"2024-04-26T07:30:16.416586+0000","last_clean":"2024-04-26T07:30:16.416586+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:30:16.416586+0000","last_undegraded":"2024-04-26T07:30:16.416586+0000","last_fullsized":"2024-04-26T07:30:16.416586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.416585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.810615+0000","last_change":"2024-04-26T07:30:16.810700+0000","last_active":"2024-04-26T07:30:16.810615+0000","last_peered":"2024-04-26T07:30:16.810615+0000","last_clean":"2024-04-26T07:30:16.810615+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:30:16.810615+0000","last_undegraded":"2024-04-26T07:30:16.810615+0000","last_fullsized":"2024-04-26T07:30:16.810615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.810615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.538993+0000","last_change":"2024-04-26T07:30:32.539075+0000","last_active":"2024-04-26T07:30:32.538993+0000","last_peered":"2024-04-26T07:30:32.538993+0000","last_clean":"2024-04-26T07:30:32.538993+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:30:32.538993+0000","last_undegraded":"2024-04-26T07:30:32.538993+0000","last_fullsized":"2024-04-26T07:30:32.538993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.538992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:28.602216+0000","last_change":"2024-04-26T07:30:28.602296+0000","last_active":"2024-04-26T07:30:28.602216+0000","last_peered":"2024-04-26T07:30:28.602216+0000","last_clean":"2024-04-26T07:30:28.602216+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:30:28.602216+0000","last_undegraded":"2024-04-26T07:30:28.602216+0000","last_fullsized":"2024-04-26T07:30:28.602216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_clean_scrub_stamp":"2024-04-26T07:30:28.602216+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.818279+0000","last_change":"2024-04-26T07:30:11.818359+0000","last_active":"2024-04-26T07:30:11.818279+0000","last_peered":"2024-04-26T07:30:11.818279+0000","last_clean":"2024-04-26T07:30:11.818279+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:30:11.818279+0000","last_undegraded":"2024-04-26T07:30:11.818279+0000","last_fullsized":"2024-04-26T07:30:11.818279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.818278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137320+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:32.137320+0000","last_peered":"2024-04-26T07:28:32.137320+0000","last_clean":"2024-04-26T07:28:32.137320+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:32.137320+0000","last_undegraded":"2024-04-26T07:28:32.137320+0000","last_fullsized":"2024-04-26T07:28:32.137320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:17.377065+0000","last_change":"2024-04-26T07:30:17.377162+0000","last_active":"2024-04-26T07:30:17.377065+0000","last_peered":"2024-04-26T07:30:17.377065+0000","last_clean":"2024-04-26T07:30:17.377065+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:30:17.377065+0000","last_undegraded":"2024-04-26T07:30:17.377065+0000","last_fullsized":"2024-04-26T07:30:17.377065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_clean_scrub_stamp":"2024-04-26T07:30:17.377064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.414289+0000","last_change":"2024-04-26T07:30:11.414367+0000","last_active":"2024-04-26T07:30:11.414289+0000","last_peered":"2024-04-26T07:30:11.414289+0000","last_clean":"2024-04-26T07:30:11.414289+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:30:11.414289+0000","last_undegraded":"2024-04-26T07:30:11.414289+0000","last_fullsized":"2024-04-26T07:30:11.414289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.414288+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:19.136227+0000","last_change":"2024-04-26T07:30:19.136319+0000","last_active":"2024-04-26T07:30:19.136227+0000","last_peered":"2024-04-26T07:30:19.136227+0000","last_clean":"2024-04-26T07:30:19.136227+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:30:19.136227+0000","last_undegraded":"2024-04-26T07:30:19.136227+0000","last_fullsized":"2024-04-26T07:30:19.136227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:19.136226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'12","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:29.574126+0000","last_change":"2024-04-26T07:30:29.574207+0000","last_active":"2024-04-26T07:30:29.574126+0000","last_peered":"2024-04-26T07:30:29.574126+0000","last_clean":"2024-04-26T07:30:29.574126+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:30:29.574126+0000","last_undegraded":"2024-04-26T07:30:29.574126+0000","last_fullsized":"2024-04-26T07:30:29.574126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_clean_scrub_stamp":"2024-04-26T07:30:29.574125+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:39.295620+0000","last_change":"2024-04-26T07:30:39.295711+0000","last_active":"2024-04-26T07:30:39.295620+0000","last_peered":"2024-04-26T07:30:39.295620+0000","last_clean":"2024-04-26T07:30:39.295620+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:30:39.295620+0000","last_undegraded":"2024-04-26T07:30:39.295620+0000","last_fullsized":"2024-04-26T07:30:39.295620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_clean_scrub_stamp":"2024-04-26T07:30:39.295619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.788374+0000","last_change":"2024-04-26T07:30:27.788453+0000","last_active":"2024-04-26T07:30:27.788374+0000","last_peered":"2024-04-26T07:30:27.788374+0000","last_clean":"2024-04-26T07:30:27.788374+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:30:27.788374+0000","last_undegraded":"2024-04-26T07:30:27.788374+0000","last_fullsized":"2024-04-26T07:30:27.788374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.788374+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:36.226727+0000","last_change":"2024-04-26T07:30:36.226816+0000","last_active":"2024-04-26T07:30:36.226727+0000","last_peered":"2024-04-26T07:30:36.226727+0000","last_clean":"2024-04-26T07:30:36.226727+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:30:36.226727+0000","last_undegraded":"2024-04-26T07:30:36.226727+0000","last_fullsized":"2024-04-26T07:30:36.226727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_clean_scrub_stamp":"2024-04-26T07:30:36.226726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140429+0000","last_change":"2024-04-26T07:28:30.852730+0000","last_active":"2024-04-26T07:28:32.140429+0000","last_peered":"2024-04-26T07:28:32.140429+0000","last_clean":"2024-04-26T07:28:32.140429+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:28:32.140429+0000","last_undegraded":"2024-04-26T07:28:32.140429+0000","last_fullsized":"2024-04-26T07:28:32.140429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.249230+0000","last_change":"2024-04-26T07:30:32.249320+0000","last_active":"2024-04-26T07:30:32.249230+0000","last_peered":"2024-04-26T07:30:32.249230+0000","last_clean":"2024-04-26T07:30:32.249230+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:30:32.249230+0000","last_undegraded":"2024-04-26T07:30:32.249230+0000","last_fullsized":"2024-04-26T07:30:32.249230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.249230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138254+0000","last_change":"2024-04-26T07:28:30.858274+0000","last_active":"2024-04-26T07:28:32.138254+0000","last_peered":"2024-04-26T07:28:32.138254+0000","last_clean":"2024-04-26T07:28:32.138254+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:28:32.138254+0000","last_undegraded":"2024-04-26T07:28:32.138254+0000","last_fullsized":"2024-04-26T07:28:32.138254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:29.804079+0000","last_clean_scrub_stamp":"2024-04-26T07:28:29.804079+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.561764+0000","last_change":"2024-04-26T07:30:31.561845+0000","last_active":"2024-04-26T07:30:31.561764+0000","last_peered":"2024-04-26T07:30:31.561764+0000","last_clean":"2024-04-26T07:30:31.561764+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:30:31.561764+0000","last_undegraded":"2024-04-26T07:30:31.561764+0000","last_fullsized":"2024-04-26T07:30:31.561764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.561764+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.216511+0000","last_change":"2024-04-26T07:30:31.216609+0000","last_active":"2024-04-26T07:30:31.216511+0000","last_peered":"2024-04-26T07:30:31.216511+0000","last_clean":"2024-04-26T07:30:31.216511+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:30:31.216511+0000","last_undegraded":"2024-04-26T07:30:31.216511+0000","last_fullsized":"2024-04-26T07:30:31.216511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.216510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.967952+0000","last_change":"2024-04-26T07:30:44.968081+0000","last_active":"2024-04-26T07:30:44.967952+0000","last_peered":"2024-04-26T07:30:44.967952+0000","last_clean":"2024-04-26T07:30:44.967952+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:30:44.967952+0000","last_undegraded":"2024-04-26T07:30:44.967952+0000","last_fullsized":"2024-04-26T07:30:44.967952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.967951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.450558+0000","last_change":"2024-04-26T07:30:50.450657+0000","last_active":"2024-04-26T07:30:50.450558+0000","last_peered":"2024-04-26T07:30:50.450558+0000","last_clean":"2024-04-26T07:30:50.450558+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:30:50.450558+0000","last_undegraded":"2024-04-26T07:30:50.450558+0000","last_fullsized":"2024-04-26T07:30:50.450558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.450557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:46.936609+0000","last_change":"2024-04-26T07:30:46.936704+0000","last_active":"2024-04-26T07:30:46.936609+0000","last_peered":"2024-04-26T07:30:46.936609+0000","last_clean":"2024-04-26T07:30:46.936609+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:30:46.936609+0000","last_undegraded":"2024-04-26T07:30:46.936609+0000","last_fullsized":"2024-04-26T07:30:46.936609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_clean_scrub_stamp":"2024-04-26T07:30:46.936608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705700,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.27000000000000002,"15min":0.26700000000000002},"min":{"1min":0.20200000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.313,"5min":0.30099999999999999,"15min":0.29899999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.28899999999999998}]},{"osd":1,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.23100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.27900000000000003}]},{"osd":2,"last update":"Fri Apr 26 07:30:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.25600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.312,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.35899999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705701,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.20999999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.30399999999999999,"15min":0.30599999999999999},"min":{"1min":0.20000000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.38800000000000001,"5min":0.442,"15min":0.442},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.29699999999999999,"15min":0.29799999999999999},"min":{"1min":0.183,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.40999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.309},{"interface":"front","average":{"1min":0.309,"5min":0.317,"15min":0.318},"min":{"1min":0.22900000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Apr 26 07:30:26 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32600000000000001,"15min":0.32800000000000001},"min":{"1min":0.221,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.47799999999999998,"5min":0.503,"15min":0.503},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.36799999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.26700000000000002},"min":{"1min":0.189,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.372},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28799999999999998},"min":{"1min":0.20300000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.28499999999999998}]},{"osd":2,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.313,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.311,"15min":0.309},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.312},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.313},"min":{"1min":0.23599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.30399999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705700,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.29899999999999999,"15min":0.29799999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.318},"min":{"1min":0.218,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Apr 26 07:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.24399999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50600000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.38500000000000001}]}]}]}} 2024-04-26T07:31:09.475 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.476 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.476 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.476 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.476 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.476 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.476 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.477 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.477 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.477 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.477 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.477 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.478 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.478 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.478 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.478 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.478 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.479 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.479 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.479 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.479 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.480 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.480 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.480 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.480 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T07:28:29.804079+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.480 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.481 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.481 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:09.481 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:31:29.482 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:31:29.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.601+0000 7fe947692700 1 Processor -- start 2024-04-26T07:31:29.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.602+0000 7fe947692700 1 -- start start 2024-04-26T07:31:29.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.602+0000 7fe947692700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe94006c990 0x7fe940136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:29.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.602+0000 7fe947692700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe940133340 0x7fe9401337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:29.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.602+0000 7fe947692700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94006cd70 con 0x7fe9400648b0 2024-04-26T07:31:29.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.602+0000 7fe947692700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe940137340 con 0x7fe94006c990 2024-04-26T07:31:29.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.602+0000 7fe947692700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe940132eb0 con 0x7fe940133340 2024-04-26T07:31:29.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.602+0000 7fe945c2f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe940133340 0x7fe9401337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:29.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.602+0000 7fe94542e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe94006c990 0x7fe940136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:29.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe944c2d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe9400648b0 0x7fe940136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46290/0 (socket says 172.21.15.31:46290) 2024-04-26T07:31:29.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe945c2f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe940133340 0x7fe9401337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46112/0 (socket says 172.21.15.31:46112) 2024-04-26T07:31:29.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe94542e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe94006c990 0x7fe940136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49336/0 (socket says 172.21.15.31:49336) 2024-04-26T07:31:29.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe944c2d700 1 -- 172.21.15.31:0/3796432109 learned_addr learned my addr 172.21.15.31:0/3796432109 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:31:29.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe933fff700 1 -- 172.21.15.31:0/3796432109 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454902962 0 0) 0x7fe94006cd70 con 0x7fe9400648b0 2024-04-26T07:31:29.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe945c2f700 1 -- 172.21.15.31:0/3796432109 >> v2:172.21.15.31:3300/0 conn(0x7fe94006c990 msgr2=0x7fe940136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:31:29.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe945c2f700 1 --2- 172.21.15.31:0/3796432109 >> v2:172.21.15.31:3300/0 conn(0x7fe94006c990 0x7fe940136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:29.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe945c2f700 1 -- 172.21.15.31:0/3796432109 >> v1:172.21.15.31:6789/0 conn(0x7fe9400648b0 legacy=0x7fe940136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:29.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe945c2f700 1 -- 172.21.15.31:0/3796432109 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe940063c00 con 0x7fe940133340 2024-04-26T07:31:29.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe94542e700 1 --2- 172.21.15.31:0/3796432109 >> v2:172.21.15.31:3300/0 conn(0x7fe94006c990 0x7fe940136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:31:29.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe945c2f700 1 --2- 172.21.15.31:0/3796432109 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe940133340 0x7fe9401337a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe9400a9bc0 tx=0x7fe9380091d0).ready entity=mon.2 client_cookie=b5847b6f4378841d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:31:29.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe933fff700 1 -- 172.21.15.31:0/3796432109 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe93800b680 con 0x7fe940133340 2024-04-26T07:31:29.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe933fff700 1 -- 172.21.15.31:0/3796432109 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93800b7e0 con 0x7fe940133340 2024-04-26T07:31:29.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.603+0000 7fe933fff700 1 -- 172.21.15.31:0/3796432109 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe93800b950 con 0x7fe940133340 2024-04-26T07:31:29.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.604+0000 7fe947692700 1 -- 172.21.15.31:0/3796432109 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe940133340 msgr2=0x7fe9401337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.604+0000 7fe947692700 1 --2- 172.21.15.31:0/3796432109 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe940133340 0x7fe9401337a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe9400a9bc0 tx=0x7fe9380091d0).stop 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.604+0000 7fe947692700 1 -- 172.21.15.31:0/3796432109 shutdown_connections 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.604+0000 7fe947692700 1 --2- 172.21.15.31:0/3796432109 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe940133340 0x7fe9401337a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.604+0000 7fe947692700 1 --2- 172.21.15.31:0/3796432109 >> v2:172.21.15.31:3300/0 conn(0x7fe94006c990 0x7fe940136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.604+0000 7fe947692700 1 -- 172.21.15.31:0/3796432109 >> 172.21.15.31:0/3796432109 conn(0x7fe940061370 msgr2=0x7fe94006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.604+0000 7fe947692700 1 -- 172.21.15.31:0/3796432109 shutdown_connections 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.604+0000 7fe947692700 1 -- 172.21.15.31:0/3796432109 wait complete. 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe947692700 1 Processor -- start 2024-04-26T07:31:29.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe947692700 1 -- start start 2024-04-26T07:31:29.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe947692700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9400648b0 0x7fe940149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:29.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe947692700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94006c990 0x7fe940149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:29.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe947692700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe940133340 0x7fe94014a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:29.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe947692700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94014a6f0 con 0x7fe940133340 2024-04-26T07:31:29.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe947692700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe940093350 con 0x7fe94006c990 2024-04-26T07:31:29.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe947692700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe940130b60 con 0x7fe9400648b0 2024-04-26T07:31:29.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe945c2f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe940133340 0x7fe94014a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:29.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe94542e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9400648b0 0x7fe940149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe944c2d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94006c990 0x7fe940149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe945c2f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe940133340 0x7fe94014a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49348/0 (socket says 172.21.15.31:49348) 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.605+0000 7fe945c2f700 1 -- 172.21.15.31:0/4058944274 learned_addr learned my addr 172.21.15.31:0/4058944274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe94542e700 1 -- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94006c990 msgr2=0x7fe940149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe94542e700 1 --2- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94006c990 0x7fe940149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe94542e700 1 -- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe940133340 msgr2=0x7fe94014a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe94542e700 1 --2- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe940133340 0x7fe94014a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe94542e700 1 -- 172.21.15.31:0/4058944274 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c00b180 con 0x7fe9400648b0 2024-04-26T07:31:29.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe945c2f700 1 --2- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe940133340 0x7fe94014a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:31:29.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe94542e700 1 --2- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9400648b0 0x7fe940149820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe9400932a0 tx=0x7fe93c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:31:29.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe9327fc700 1 -- 172.21.15.31:0/4058944274 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe93c010780 con 0x7fe9400648b0 2024-04-26T07:31:29.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe9327fc700 1 -- 172.21.15.31:0/4058944274 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c0108e0 con 0x7fe9400648b0 2024-04-26T07:31:29.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe938009470 con 0x7fe9400648b0 2024-04-26T07:31:29.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe9327fc700 1 -- 172.21.15.31:0/4058944274 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe93c010c40 con 0x7fe9400648b0 2024-04-26T07:31:29.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.606+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9400665d0 con 0x7fe9400648b0 2024-04-26T07:31:29.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.607+0000 7fe9327fc700 1 -- 172.21.15.31:0/4058944274 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe93c01c460 con 0x7fe9400648b0 2024-04-26T07:31:29.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.607+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe940092f70 con 0x7fe9400648b0 2024-04-26T07:31:29.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.607+0000 7fe9327fc700 1 -- 172.21.15.31:0/4058944274 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe93c04ac40 con 0x7fe9400648b0 2024-04-26T07:31:29.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.610+0000 7fe9327fc700 1 -- 172.21.15.31:0/4058944274 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe93c0334d0 con 0x7fe9400648b0 2024-04-26T07:31:29.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.724+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe940098d60 con 0x7fe920038f50 2024-04-26T07:31:29.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.731+0000 7fe9327fc700 1 -- 172.21.15.31:0/4058944274 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252186 (unknown 2965378022 0 603964805) 0x7fe940098d60 con 0x7fe920038f50 2024-04-26T07:31:29.735 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:31:29.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 >> v1:172.21.15.31:6816/39613 conn(0x7fe920038f50 legacy=0x7fe92003b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:29.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9400648b0 msgr2=0x7fe940149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:29.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 --2- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9400648b0 0x7fe940149820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe9400932a0 tx=0x7fe93c006df0).stop 2024-04-26T07:31:29.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 shutdown_connections 2024-04-26T07:31:29.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 --2- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9400648b0 0x7fe940149820 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:29.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 --2- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe940133340 0x7fe94014a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:29.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 --2- 172.21.15.31:0/4058944274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94006c990 0x7fe940149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:29.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 >> 172.21.15.31:0/4058944274 conn(0x7fe940061370 msgr2=0x7fe940062800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:31:29.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 shutdown_connections 2024-04-26T07:31:29.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:29.733+0000 7fe947692700 1 -- 172.21.15.31:0/4058944274 wait complete. 2024-04-26T07:31:29.739 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:31:29.744 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-04-26T07:31:28.015481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13536,"num_omap_keys":21,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002628"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.426802+0000","last_change":"2024-04-26T07:30:52.426911+0000","last_active":"2024-04-26T07:30:52.426802+0000","last_peered":"2024-04-26T07:30:52.426802+0000","last_clean":"2024-04-26T07:30:52.426802+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:30:52.426802+0000","last_undegraded":"2024-04-26T07:30:52.426802+0000","last_fullsized":"2024-04-26T07:30:52.426802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.426801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.387022+0000","last_change":"2024-04-26T07:30:51.387112+0000","last_active":"2024-04-26T07:30:51.387022+0000","last_peered":"2024-04-26T07:30:51.387022+0000","last_clean":"2024-04-26T07:30:51.387022+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:30:51.387022+0000","last_undegraded":"2024-04-26T07:30:51.387022+0000","last_fullsized":"2024-04-26T07:30:51.387022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.387021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:17.334912+0000","last_change":"2024-04-26T07:31:17.335002+0000","last_active":"2024-04-26T07:31:17.334912+0000","last_peered":"2024-04-26T07:31:17.334912+0000","last_clean":"2024-04-26T07:31:17.334912+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:31:17.334912+0000","last_undegraded":"2024-04-26T07:31:17.334912+0000","last_fullsized":"2024-04-26T07:31:17.334912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:17.334911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:17.334911+0000","last_clean_scrub_stamp":"2024-04-26T07:31:17.334911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:16.290874+0000","last_change":"2024-04-26T07:31:16.290972+0000","last_active":"2024-04-26T07:31:16.290874+0000","last_peered":"2024-04-26T07:31:16.290874+0000","last_clean":"2024-04-26T07:31:16.290874+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:31:16.290874+0000","last_undegraded":"2024-04-26T07:31:16.290874+0000","last_fullsized":"2024-04-26T07:31:16.290874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:16.290873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:16.290873+0000","last_clean_scrub_stamp":"2024-04-26T07:31:16.290873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:13.357195+0000","last_change":"2024-04-26T07:31:13.357281+0000","last_active":"2024-04-26T07:31:13.357195+0000","last_peered":"2024-04-26T07:31:13.357195+0000","last_clean":"2024-04-26T07:31:13.357195+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:31:13.357195+0000","last_undegraded":"2024-04-26T07:31:13.357195+0000","last_fullsized":"2024-04-26T07:31:13.357195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:13.357195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:13.357195+0000","last_clean_scrub_stamp":"2024-04-26T07:31:13.357195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:12.068148+0000","last_change":"2024-04-26T07:31:12.068229+0000","last_active":"2024-04-26T07:31:12.068148+0000","last_peered":"2024-04-26T07:31:12.068148+0000","last_clean":"2024-04-26T07:31:12.068148+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:31:12.068148+0000","last_undegraded":"2024-04-26T07:31:12.068148+0000","last_fullsized":"2024-04-26T07:31:12.068148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:12.068147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:12.068147+0000","last_clean_scrub_stamp":"2024-04-26T07:31:12.068147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:12.351167+0000","last_change":"2024-04-26T07:31:12.351287+0000","last_active":"2024-04-26T07:31:12.351167+0000","last_peered":"2024-04-26T07:31:12.351167+0000","last_clean":"2024-04-26T07:31:12.351167+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:31:12.351167+0000","last_undegraded":"2024-04-26T07:31:12.351167+0000","last_fullsized":"2024-04-26T07:31:12.351167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:12.351167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:12.351167+0000","last_clean_scrub_stamp":"2024-04-26T07:31:12.351167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.047204+0000","last_change":"2024-04-26T07:31:06.047291+0000","last_active":"2024-04-26T07:31:06.047204+0000","last_peered":"2024-04-26T07:31:06.047204+0000","last_clean":"2024-04-26T07:31:06.047204+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:31:06.047204+0000","last_undegraded":"2024-04-26T07:31:06.047204+0000","last_fullsized":"2024-04-26T07:31:06.047204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.047203+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:04.079986+0000","last_change":"2024-04-26T07:31:04.080077+0000","last_active":"2024-04-26T07:31:04.079986+0000","last_peered":"2024-04-26T07:31:04.079986+0000","last_clean":"2024-04-26T07:31:04.079986+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:31:04.079986+0000","last_undegraded":"2024-04-26T07:31:04.079986+0000","last_fullsized":"2024-04-26T07:31:04.079986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_clean_scrub_stamp":"2024-04-26T07:31:04.079985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:47.333000+0000","last_change":"2024-04-26T07:30:47.333131+0000","last_active":"2024-04-26T07:30:47.333000+0000","last_peered":"2024-04-26T07:30:47.333000+0000","last_clean":"2024-04-26T07:30:47.333000+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:30:47.333000+0000","last_undegraded":"2024-04-26T07:30:47.333000+0000","last_fullsized":"2024-04-26T07:30:47.333000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_clean_scrub_stamp":"2024-04-26T07:30:47.333000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.307226+0000","last_change":"2024-04-26T07:30:42.307331+0000","last_active":"2024-04-26T07:30:42.307226+0000","last_peered":"2024-04-26T07:30:42.307226+0000","last_clean":"2024-04-26T07:30:42.307226+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:30:42.307226+0000","last_undegraded":"2024-04-26T07:30:42.307226+0000","last_fullsized":"2024-04-26T07:30:42.307226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.307226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:00.092689+0000","last_change":"2024-04-26T07:31:00.092776+0000","last_active":"2024-04-26T07:31:00.092689+0000","last_peered":"2024-04-26T07:31:00.092689+0000","last_clean":"2024-04-26T07:31:00.092689+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:31:00.092689+0000","last_undegraded":"2024-04-26T07:31:00.092689+0000","last_fullsized":"2024-04-26T07:31:00.092689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_clean_scrub_stamp":"2024-04-26T07:31:00.092689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:10.341169+0000","last_change":"2024-04-26T07:31:10.341266+0000","last_active":"2024-04-26T07:31:10.341169+0000","last_peered":"2024-04-26T07:31:10.341169+0000","last_clean":"2024-04-26T07:31:10.341169+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:31:10.341169+0000","last_undegraded":"2024-04-26T07:31:10.341169+0000","last_fullsized":"2024-04-26T07:31:10.341169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:10.341168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:10.341168+0000","last_clean_scrub_stamp":"2024-04-26T07:31:10.341168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.307189+0000","last_change":"2024-04-26T07:31:06.307276+0000","last_active":"2024-04-26T07:31:06.307189+0000","last_peered":"2024-04-26T07:31:06.307189+0000","last_clean":"2024-04-26T07:31:06.307189+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:31:06.307189+0000","last_undegraded":"2024-04-26T07:31:06.307189+0000","last_fullsized":"2024-04-26T07:31:06.307189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.307188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:59.385202+0000","last_change":"2024-04-26T07:30:59.385291+0000","last_active":"2024-04-26T07:30:59.385202+0000","last_peered":"2024-04-26T07:30:59.385202+0000","last_clean":"2024-04-26T07:30:59.385202+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:30:59.385202+0000","last_undegraded":"2024-04-26T07:30:59.385202+0000","last_fullsized":"2024-04-26T07:30:59.385202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_clean_scrub_stamp":"2024-04-26T07:30:59.385201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:40.294718+0000","last_change":"2024-04-26T07:30:40.294811+0000","last_active":"2024-04-26T07:30:40.294718+0000","last_peered":"2024-04-26T07:30:40.294718+0000","last_clean":"2024-04-26T07:30:40.294718+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:30:40.294718+0000","last_undegraded":"2024-04-26T07:30:40.294718+0000","last_fullsized":"2024-04-26T07:30:40.294718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_clean_scrub_stamp":"2024-04-26T07:30:40.294717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.022023+0000","last_change":"2024-04-26T07:30:56.022116+0000","last_active":"2024-04-26T07:30:56.022023+0000","last_peered":"2024-04-26T07:30:56.022023+0000","last_clean":"2024-04-26T07:30:56.022023+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:30:56.022023+0000","last_undegraded":"2024-04-26T07:30:56.022023+0000","last_fullsized":"2024-04-26T07:30:56.022023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.022022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:55.027604+0000","last_change":"2024-04-26T07:30:55.027705+0000","last_active":"2024-04-26T07:30:55.027604+0000","last_peered":"2024-04-26T07:30:55.027604+0000","last_clean":"2024-04-26T07:30:55.027604+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:30:55.027604+0000","last_undegraded":"2024-04-26T07:30:55.027604+0000","last_fullsized":"2024-04-26T07:30:55.027604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_clean_scrub_stamp":"2024-04-26T07:30:55.027603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.447536+0000","last_change":"2024-04-26T07:30:52.447634+0000","last_active":"2024-04-26T07:30:52.447536+0000","last_peered":"2024-04-26T07:30:52.447536+0000","last_clean":"2024-04-26T07:30:52.447536+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:30:52.447536+0000","last_undegraded":"2024-04-26T07:30:52.447536+0000","last_fullsized":"2024-04-26T07:30:52.447536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.447536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:54.059185+0000","last_change":"2024-04-26T07:30:54.059310+0000","last_active":"2024-04-26T07:30:54.059185+0000","last_peered":"2024-04-26T07:30:54.059185+0000","last_clean":"2024-04-26T07:30:54.059185+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:30:54.059185+0000","last_undegraded":"2024-04-26T07:30:54.059185+0000","last_fullsized":"2024-04-26T07:30:54.059185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_clean_scrub_stamp":"2024-04-26T07:30:54.059185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:53.020287+0000","last_change":"2024-04-26T07:30:53.020393+0000","last_active":"2024-04-26T07:30:53.020287+0000","last_peered":"2024-04-26T07:30:53.020287+0000","last_clean":"2024-04-26T07:30:53.020287+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:30:53.020287+0000","last_undegraded":"2024-04-26T07:30:53.020287+0000","last_fullsized":"2024-04-26T07:30:53.020287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_clean_scrub_stamp":"2024-04-26T07:30:53.020286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.976317+0000","last_change":"2024-04-26T07:30:50.976414+0000","last_active":"2024-04-26T07:30:50.976317+0000","last_peered":"2024-04-26T07:30:50.976317+0000","last_clean":"2024-04-26T07:30:50.976317+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:30:50.976317+0000","last_undegraded":"2024-04-26T07:30:50.976317+0000","last_fullsized":"2024-04-26T07:30:50.976317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.976316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.890710+0000","last_change":"2024-04-26T07:30:23.890791+0000","last_active":"2024-04-26T07:30:23.890710+0000","last_peered":"2024-04-26T07:30:23.890710+0000","last_clean":"2024-04-26T07:30:23.890710+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:30:23.890710+0000","last_undegraded":"2024-04-26T07:30:23.890710+0000","last_fullsized":"2024-04-26T07:30:23.890710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.890710+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:22.844919+0000","last_change":"2024-04-26T07:30:22.845011+0000","last_active":"2024-04-26T07:30:22.844919+0000","last_peered":"2024-04-26T07:30:22.844919+0000","last_clean":"2024-04-26T07:30:22.844919+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:30:22.844919+0000","last_undegraded":"2024-04-26T07:30:22.844919+0000","last_fullsized":"2024-04-26T07:30:22.844919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_clean_scrub_stamp":"2024-04-26T07:30:22.844919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.440808+0000","last_change":"2024-04-26T07:30:44.440891+0000","last_active":"2024-04-26T07:30:44.440808+0000","last_peered":"2024-04-26T07:30:44.440808+0000","last_clean":"2024-04-26T07:30:44.440808+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:30:44.440808+0000","last_undegraded":"2024-04-26T07:30:44.440808+0000","last_fullsized":"2024-04-26T07:30:44.440808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.440807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:08.046243+0000","last_change":"2024-04-26T07:31:08.046335+0000","last_active":"2024-04-26T07:31:08.046243+0000","last_peered":"2024-04-26T07:31:08.046243+0000","last_clean":"2024-04-26T07:31:08.046243+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:31:08.046243+0000","last_undegraded":"2024-04-26T07:31:08.046243+0000","last_fullsized":"2024-04-26T07:31:08.046243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:31:08.046243+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:31:08.046243+0000","last_clean_scrub_stamp":"2024-04-26T07:31:08.046243+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'9","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.580238+0000","last_change":"2024-04-26T07:30:25.580325+0000","last_active":"2024-04-26T07:30:25.580238+0000","last_peered":"2024-04-26T07:30:25.580238+0000","last_clean":"2024-04-26T07:30:25.580238+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:30:25.580238+0000","last_undegraded":"2024-04-26T07:30:25.580238+0000","last_fullsized":"2024-04-26T07:30:25.580238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'9","last_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_deep_scrub":"19'9","last_deep_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.580237+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137664+0000","last_change":"2024-04-26T07:28:31.161627+0000","last_active":"2024-04-26T07:28:32.137664+0000","last_peered":"2024-04-26T07:28:32.137664+0000","last_clean":"2024-04-26T07:28:32.137664+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:28:32.137664+0000","last_undegraded":"2024-04-26T07:28:32.137664+0000","last_fullsized":"2024-04-26T07:28:32.137664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.163184+0000","last_change":"2024-04-26T07:30:15.163266+0000","last_active":"2024-04-26T07:30:15.163184+0000","last_peered":"2024-04-26T07:30:15.163184+0000","last_clean":"2024-04-26T07:30:15.163184+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:30:15.163184+0000","last_undegraded":"2024-04-26T07:30:15.163184+0000","last_fullsized":"2024-04-26T07:30:15.163184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.163183+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138363+0000","last_change":"2024-04-26T07:28:31.174380+0000","last_active":"2024-04-26T07:28:32.138363+0000","last_peered":"2024-04-26T07:28:32.138363+0000","last_clean":"2024-04-26T07:28:32.138363+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:28:32.138363+0000","last_undegraded":"2024-04-26T07:28:32.138363+0000","last_fullsized":"2024-04-26T07:28:32.138363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.570415+0000","last_change":"2024-04-26T07:30:23.570499+0000","last_active":"2024-04-26T07:30:23.570415+0000","last_peered":"2024-04-26T07:30:23.570415+0000","last_clean":"2024-04-26T07:30:23.570415+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:30:23.570415+0000","last_undegraded":"2024-04-26T07:30:23.570415+0000","last_fullsized":"2024-04-26T07:30:23.570415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.570415+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.011724+0000","last_change":"2024-04-26T07:30:44.011821+0000","last_active":"2024-04-26T07:30:44.011724+0000","last_peered":"2024-04-26T07:30:44.011724+0000","last_clean":"2024-04-26T07:30:44.011724+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:30:44.011724+0000","last_undegraded":"2024-04-26T07:30:44.011724+0000","last_fullsized":"2024-04-26T07:30:44.011724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.011723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'21","reported_seq":35,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:07.012832+0000","last_change":"2024-04-26T07:31:07.012911+0000","last_active":"2024-04-26T07:31:07.012832+0000","last_peered":"2024-04-26T07:31:07.012832+0000","last_clean":"2024-04-26T07:31:07.012832+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:31:07.012832+0000","last_undegraded":"2024-04-26T07:31:07.012832+0000","last_fullsized":"2024-04-26T07:31:07.012832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'21","last_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_deep_scrub":"19'21","last_deep_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_clean_scrub_stamp":"2024-04-26T07:31:07.012831+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.232011+0000","last_change":"2024-04-26T07:30:27.232105+0000","last_active":"2024-04-26T07:30:27.232011+0000","last_peered":"2024-04-26T07:30:27.232011+0000","last_clean":"2024-04-26T07:30:27.232011+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:30:27.232011+0000","last_undegraded":"2024-04-26T07:30:27.232011+0000","last_fullsized":"2024-04-26T07:30:27.232011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.232010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:01.928484+0000","last_change":"2024-04-26T07:31:01.928571+0000","last_active":"2024-04-26T07:31:01.928484+0000","last_peered":"2024-04-26T07:31:01.928484+0000","last_clean":"2024-04-26T07:31:01.928484+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:31:01.928484+0000","last_undegraded":"2024-04-26T07:31:01.928484+0000","last_fullsized":"2024-04-26T07:31:01.928484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_clean_scrub_stamp":"2024-04-26T07:31:01.928484+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137836+0000","last_change":"2024-04-26T07:28:31.158498+0000","last_active":"2024-04-26T07:28:32.137836+0000","last_peered":"2024-04-26T07:28:32.137836+0000","last_clean":"2024-04-26T07:28:32.137836+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:28:32.137836+0000","last_undegraded":"2024-04-26T07:28:32.137836+0000","last_fullsized":"2024-04-26T07:28:32.137836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:21.505390+0000","last_change":"2024-04-26T07:30:21.505470+0000","last_active":"2024-04-26T07:30:21.505390+0000","last_peered":"2024-04-26T07:30:21.505390+0000","last_clean":"2024-04-26T07:30:21.505390+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:30:21.505390+0000","last_undegraded":"2024-04-26T07:30:21.505390+0000","last_fullsized":"2024-04-26T07:30:21.505390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_clean_scrub_stamp":"2024-04-26T07:30:21.505390+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139915+0000","last_change":"2024-04-26T07:28:31.174952+0000","last_active":"2024-04-26T07:28:32.139915+0000","last_peered":"2024-04-26T07:28:32.139915+0000","last_clean":"2024-04-26T07:28:32.139915+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:28:32.139915+0000","last_undegraded":"2024-04-26T07:28:32.139915+0000","last_fullsized":"2024-04-26T07:28:32.139915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.845651+0000","last_change":"2024-04-26T07:30:56.845747+0000","last_active":"2024-04-26T07:30:56.845651+0000","last_peered":"2024-04-26T07:30:56.845651+0000","last_clean":"2024-04-26T07:30:56.845651+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:30:56.845651+0000","last_undegraded":"2024-04-26T07:30:56.845651+0000","last_fullsized":"2024-04-26T07:30:56.845651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.845650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.427936+0000","last_change":"2024-04-26T07:30:42.428022+0000","last_active":"2024-04-26T07:30:42.427936+0000","last_peered":"2024-04-26T07:30:42.427936+0000","last_clean":"2024-04-26T07:30:42.427936+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:30:42.427936+0000","last_undegraded":"2024-04-26T07:30:42.427936+0000","last_fullsized":"2024-04-26T07:30:42.427936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.427935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'15","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:18.834721+0000","last_change":"2024-04-26T07:30:18.834800+0000","last_active":"2024-04-26T07:30:18.834721+0000","last_peered":"2024-04-26T07:30:18.834721+0000","last_clean":"2024-04-26T07:30:18.834721+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:30:18.834721+0000","last_undegraded":"2024-04-26T07:30:18.834721+0000","last_fullsized":"2024-04-26T07:30:18.834721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'15","last_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_deep_scrub":"19'15","last_deep_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_clean_scrub_stamp":"2024-04-26T07:30:18.834720+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139763+0000","last_change":"2024-04-26T07:28:31.173118+0000","last_active":"2024-04-26T07:28:32.139763+0000","last_peered":"2024-04-26T07:28:32.139763+0000","last_clean":"2024-04-26T07:28:32.139763+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:28:32.139763+0000","last_undegraded":"2024-04-26T07:28:32.139763+0000","last_fullsized":"2024-04-26T07:28:32.139763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.546240+0000","last_change":"2024-04-26T07:30:20.546354+0000","last_active":"2024-04-26T07:30:20.546240+0000","last_peered":"2024-04-26T07:30:20.546240+0000","last_clean":"2024-04-26T07:30:20.546240+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:30:20.546240+0000","last_undegraded":"2024-04-26T07:30:20.546240+0000","last_fullsized":"2024-04-26T07:30:20.546240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.546239+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137801+0000","last_change":"2024-04-26T07:28:31.161837+0000","last_active":"2024-04-26T07:28:32.137801+0000","last_peered":"2024-04-26T07:28:32.137801+0000","last_clean":"2024-04-26T07:28:32.137801+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:28:32.137801+0000","last_undegraded":"2024-04-26T07:28:32.137801+0000","last_fullsized":"2024-04-26T07:28:32.137801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:13.068833+0000","last_change":"2024-04-26T07:30:13.068913+0000","last_active":"2024-04-26T07:30:13.068833+0000","last_peered":"2024-04-26T07:30:13.068833+0000","last_clean":"2024-04-26T07:30:13.068833+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:30:13.068833+0000","last_undegraded":"2024-04-26T07:30:13.068833+0000","last_fullsized":"2024-04-26T07:30:13.068833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:13.068832+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.955449+0000","last_change":"2024-04-26T07:30:38.955557+0000","last_active":"2024-04-26T07:30:38.955449+0000","last_peered":"2024-04-26T07:30:38.955449+0000","last_clean":"2024-04-26T07:30:38.955449+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:30:38.955449+0000","last_undegraded":"2024-04-26T07:30:38.955449+0000","last_fullsized":"2024-04-26T07:30:38.955449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.955449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.700832+0000","last_change":"2024-04-26T07:30:51.700910+0000","last_active":"2024-04-26T07:30:51.700832+0000","last_peered":"2024-04-26T07:30:51.700832+0000","last_clean":"2024-04-26T07:30:51.700832+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:30:51.700832+0000","last_undegraded":"2024-04-26T07:30:51.700832+0000","last_fullsized":"2024-04-26T07:30:51.700832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.700832+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.148236+0000","last_change":"2024-04-26T07:30:20.148325+0000","last_active":"2024-04-26T07:30:20.148236+0000","last_peered":"2024-04-26T07:30:20.148236+0000","last_clean":"2024-04-26T07:30:20.148236+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:30:20.148236+0000","last_undegraded":"2024-04-26T07:30:20.148236+0000","last_fullsized":"2024-04-26T07:30:20.148236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.148235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.511807+0000","last_change":"2024-04-26T07:30:16.511900+0000","last_active":"2024-04-26T07:30:16.511807+0000","last_peered":"2024-04-26T07:30:16.511807+0000","last_clean":"2024-04-26T07:30:16.511807+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:30:16.511807+0000","last_undegraded":"2024-04-26T07:30:16.511807+0000","last_fullsized":"2024-04-26T07:30:16.511807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.511806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:34.479850+0000","last_change":"2024-04-26T07:30:34.479942+0000","last_active":"2024-04-26T07:30:34.479850+0000","last_peered":"2024-04-26T07:30:34.479850+0000","last_clean":"2024-04-26T07:30:34.479850+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:30:34.479850+0000","last_undegraded":"2024-04-26T07:30:34.479850+0000","last_fullsized":"2024-04-26T07:30:34.479850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_clean_scrub_stamp":"2024-04-26T07:30:34.479849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:49.675793+0000","last_change":"2024-04-26T07:30:49.675867+0000","last_active":"2024-04-26T07:30:49.675793+0000","last_peered":"2024-04-26T07:30:49.675793+0000","last_clean":"2024-04-26T07:30:49.675793+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:30:49.675793+0000","last_undegraded":"2024-04-26T07:30:49.675793+0000","last_fullsized":"2024-04-26T07:30:49.675793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_clean_scrub_stamp":"2024-04-26T07:30:49.675793+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.454434+0000","last_change":"2024-04-26T07:30:38.454554+0000","last_active":"2024-04-26T07:30:38.454434+0000","last_peered":"2024-04-26T07:30:38.454434+0000","last_clean":"2024-04-26T07:30:38.454434+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:30:38.454434+0000","last_undegraded":"2024-04-26T07:30:38.454434+0000","last_fullsized":"2024-04-26T07:30:38.454434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.454433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.698682+0000","last_change":"2024-04-26T07:30:42.698763+0000","last_active":"2024-04-26T07:30:42.698682+0000","last_peered":"2024-04-26T07:30:42.698682+0000","last_clean":"2024-04-26T07:30:42.698682+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:30:42.698682+0000","last_undegraded":"2024-04-26T07:30:42.698682+0000","last_fullsized":"2024-04-26T07:30:42.698682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.698682+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140027+0000","last_change":"2024-04-26T07:28:31.159687+0000","last_active":"2024-04-26T07:28:32.140027+0000","last_peered":"2024-04-26T07:28:32.140027+0000","last_clean":"2024-04-26T07:28:32.140027+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:28:32.140027+0000","last_undegraded":"2024-04-26T07:28:32.140027+0000","last_fullsized":"2024-04-26T07:28:32.140027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:35.647109+0000","last_change":"2024-04-26T07:30:35.647193+0000","last_active":"2024-04-26T07:30:35.647109+0000","last_peered":"2024-04-26T07:30:35.647109+0000","last_clean":"2024-04-26T07:30:35.647109+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:30:35.647109+0000","last_undegraded":"2024-04-26T07:30:35.647109+0000","last_fullsized":"2024-04-26T07:30:35.647109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_clean_scrub_stamp":"2024-04-26T07:30:35.647108+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.207071+0000","last_change":"2024-04-26T07:30:25.207160+0000","last_active":"2024-04-26T07:30:25.207071+0000","last_peered":"2024-04-26T07:30:25.207071+0000","last_clean":"2024-04-26T07:30:25.207071+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:30:25.207071+0000","last_undegraded":"2024-04-26T07:30:25.207071+0000","last_fullsized":"2024-04-26T07:30:25.207071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.207070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.679673+0000","last_change":"2024-04-26T07:30:33.679748+0000","last_active":"2024-04-26T07:30:33.679673+0000","last_peered":"2024-04-26T07:30:33.679673+0000","last_clean":"2024-04-26T07:30:33.679673+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:30:33.679673+0000","last_undegraded":"2024-04-26T07:30:33.679673+0000","last_fullsized":"2024-04-26T07:30:33.679673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.679672+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:43.016723+0000","last_change":"2024-04-26T07:30:43.016816+0000","last_active":"2024-04-26T07:30:43.016723+0000","last_peered":"2024-04-26T07:30:43.016723+0000","last_clean":"2024-04-26T07:30:43.016723+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:30:43.016723+0000","last_undegraded":"2024-04-26T07:30:43.016723+0000","last_fullsized":"2024-04-26T07:30:43.016723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:43.016723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.867473+0000","last_change":"2024-04-26T07:30:09.867557+0000","last_active":"2024-04-26T07:30:09.867473+0000","last_peered":"2024-04-26T07:30:09.867473+0000","last_clean":"2024-04-26T07:30:09.867473+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:30:09.867473+0000","last_undegraded":"2024-04-26T07:30:09.867473+0000","last_fullsized":"2024-04-26T07:30:09.867473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.867473+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.023356+0000","last_change":"2024-04-26T07:30:11.023477+0000","last_active":"2024-04-26T07:30:11.023356+0000","last_peered":"2024-04-26T07:30:11.023356+0000","last_clean":"2024-04-26T07:30:11.023356+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:30:11.023356+0000","last_undegraded":"2024-04-26T07:30:11.023356+0000","last_fullsized":"2024-04-26T07:30:11.023356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.023356+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:30.811830+0000","last_change":"2024-04-26T07:30:30.811917+0000","last_active":"2024-04-26T07:30:30.811830+0000","last_peered":"2024-04-26T07:30:30.811830+0000","last_clean":"2024-04-26T07:30:30.811830+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:30:30.811830+0000","last_undegraded":"2024-04-26T07:30:30.811830+0000","last_fullsized":"2024-04-26T07:30:30.811830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_clean_scrub_stamp":"2024-04-26T07:30:30.811830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:14.491026+0000","last_change":"2024-04-26T07:30:14.491123+0000","last_active":"2024-04-26T07:30:14.491026+0000","last_peered":"2024-04-26T07:30:14.491026+0000","last_clean":"2024-04-26T07:30:14.491026+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:30:14.491026+0000","last_undegraded":"2024-04-26T07:30:14.491026+0000","last_fullsized":"2024-04-26T07:30:14.491026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_clean_scrub_stamp":"2024-04-26T07:30:14.491025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.413359+0000","last_change":"2024-04-26T07:30:09.413441+0000","last_active":"2024-04-26T07:30:09.413359+0000","last_peered":"2024-04-26T07:30:09.413359+0000","last_clean":"2024-04-26T07:30:09.413359+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:30:09.413359+0000","last_undegraded":"2024-04-26T07:30:09.413359+0000","last_fullsized":"2024-04-26T07:30:09.413359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.413358+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.849915+0000","last_change":"2024-04-26T07:30:31.850005+0000","last_active":"2024-04-26T07:30:31.849915+0000","last_peered":"2024-04-26T07:30:31.849915+0000","last_clean":"2024-04-26T07:30:31.849915+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:30:31.849915+0000","last_undegraded":"2024-04-26T07:30:31.849915+0000","last_fullsized":"2024-04-26T07:30:31.849915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.849914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.028509+0000","last_change":"2024-04-26T07:30:08.028621+0000","last_active":"2024-04-26T07:30:08.028509+0000","last_peered":"2024-04-26T07:30:08.028509+0000","last_clean":"2024-04-26T07:30:08.028509+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:30:08.028509+0000","last_undegraded":"2024-04-26T07:30:08.028509+0000","last_fullsized":"2024-04-26T07:30:08.028509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.028509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.809606+0000","last_change":"2024-04-26T07:30:12.809726+0000","last_active":"2024-04-26T07:30:12.809606+0000","last_peered":"2024-04-26T07:30:12.809606+0000","last_clean":"2024-04-26T07:30:12.809606+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:30:12.809606+0000","last_undegraded":"2024-04-26T07:30:12.809606+0000","last_fullsized":"2024-04-26T07:30:12.809606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.809605+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.923160+0000","last_change":"2024-04-26T07:30:33.923250+0000","last_active":"2024-04-26T07:30:33.923160+0000","last_peered":"2024-04-26T07:30:33.923160+0000","last_clean":"2024-04-26T07:30:33.923160+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:30:33.923160+0000","last_undegraded":"2024-04-26T07:30:33.923160+0000","last_fullsized":"2024-04-26T07:30:33.923160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.923160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.443421+0000","last_change":"2024-04-26T07:30:15.443501+0000","last_active":"2024-04-26T07:30:15.443421+0000","last_peered":"2024-04-26T07:30:15.443421+0000","last_clean":"2024-04-26T07:30:15.443421+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:30:15.443421+0000","last_undegraded":"2024-04-26T07:30:15.443421+0000","last_fullsized":"2024-04-26T07:30:15.443421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.443421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.891685+0000","last_change":"2024-04-26T07:30:08.891750+0000","last_active":"2024-04-26T07:30:08.891685+0000","last_peered":"2024-04-26T07:30:08.891685+0000","last_clean":"2024-04-26T07:30:08.891685+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:30:08.891685+0000","last_undegraded":"2024-04-26T07:30:08.891685+0000","last_fullsized":"2024-04-26T07:30:08.891685+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.891685+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.436730+0000","last_change":"2024-04-26T07:30:20.436817+0000","last_active":"2024-04-26T07:30:20.436730+0000","last_peered":"2024-04-26T07:30:20.436730+0000","last_clean":"2024-04-26T07:30:20.436730+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:30:20.436730+0000","last_undegraded":"2024-04-26T07:30:20.436730+0000","last_fullsized":"2024-04-26T07:30:20.436730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.436730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.140556+0000","last_change":"2024-04-26T07:28:31.172273+0000","last_active":"2024-04-26T07:28:32.140556+0000","last_peered":"2024-04-26T07:28:32.140556+0000","last_clean":"2024-04-26T07:28:32.140556+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:28:32.140556+0000","last_undegraded":"2024-04-26T07:28:32.140556+0000","last_fullsized":"2024-04-26T07:28:32.140556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.493074+0000","last_change":"2024-04-26T07:30:12.493165+0000","last_active":"2024-04-26T07:30:12.493074+0000","last_peered":"2024-04-26T07:30:12.493074+0000","last_clean":"2024-04-26T07:30:12.493074+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:30:12.493074+0000","last_undegraded":"2024-04-26T07:30:12.493074+0000","last_fullsized":"2024-04-26T07:30:12.493074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.493074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.440210+0000","last_change":"2024-04-26T07:30:08.440323+0000","last_active":"2024-04-26T07:30:08.440210+0000","last_peered":"2024-04-26T07:30:08.440210+0000","last_clean":"2024-04-26T07:30:08.440210+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:30:08.440210+0000","last_undegraded":"2024-04-26T07:30:08.440210+0000","last_fullsized":"2024-04-26T07:30:08.440210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.440209+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.503368+0000","last_change":"2024-04-26T07:30:33.503463+0000","last_active":"2024-04-26T07:30:33.503368+0000","last_peered":"2024-04-26T07:30:33.503368+0000","last_clean":"2024-04-26T07:30:33.503368+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:30:33.503368+0000","last_undegraded":"2024-04-26T07:30:33.503368+0000","last_fullsized":"2024-04-26T07:30:33.503368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.503367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.416586+0000","last_change":"2024-04-26T07:30:16.416716+0000","last_active":"2024-04-26T07:30:16.416586+0000","last_peered":"2024-04-26T07:30:16.416586+0000","last_clean":"2024-04-26T07:30:16.416586+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:30:16.416586+0000","last_undegraded":"2024-04-26T07:30:16.416586+0000","last_fullsized":"2024-04-26T07:30:16.416586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.416585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.810615+0000","last_change":"2024-04-26T07:30:16.810700+0000","last_active":"2024-04-26T07:30:16.810615+0000","last_peered":"2024-04-26T07:30:16.810615+0000","last_clean":"2024-04-26T07:30:16.810615+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:30:16.810615+0000","last_undegraded":"2024-04-26T07:30:16.810615+0000","last_fullsized":"2024-04-26T07:30:16.810615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.810615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.538993+0000","last_change":"2024-04-26T07:30:32.539075+0000","last_active":"2024-04-26T07:30:32.538993+0000","last_peered":"2024-04-26T07:30:32.538993+0000","last_clean":"2024-04-26T07:30:32.538993+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:30:32.538993+0000","last_undegraded":"2024-04-26T07:30:32.538993+0000","last_fullsized":"2024-04-26T07:30:32.538993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.538992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:28.602216+0000","last_change":"2024-04-26T07:30:28.602296+0000","last_active":"2024-04-26T07:30:28.602216+0000","last_peered":"2024-04-26T07:30:28.602216+0000","last_clean":"2024-04-26T07:30:28.602216+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:30:28.602216+0000","last_undegraded":"2024-04-26T07:30:28.602216+0000","last_fullsized":"2024-04-26T07:30:28.602216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_clean_scrub_stamp":"2024-04-26T07:30:28.602216+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.818279+0000","last_change":"2024-04-26T07:30:11.818359+0000","last_active":"2024-04-26T07:30:11.818279+0000","last_peered":"2024-04-26T07:30:11.818279+0000","last_clean":"2024-04-26T07:30:11.818279+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:30:11.818279+0000","last_undegraded":"2024-04-26T07:30:11.818279+0000","last_fullsized":"2024-04-26T07:30:11.818279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.818278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137320+0000","last_change":"2024-04-26T07:28:31.163124+0000","last_active":"2024-04-26T07:28:32.137320+0000","last_peered":"2024-04-26T07:28:32.137320+0000","last_clean":"2024-04-26T07:28:32.137320+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:28:32.137320+0000","last_undegraded":"2024-04-26T07:28:32.137320+0000","last_fullsized":"2024-04-26T07:28:32.137320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:17.377065+0000","last_change":"2024-04-26T07:30:17.377162+0000","last_active":"2024-04-26T07:30:17.377065+0000","last_peered":"2024-04-26T07:30:17.377065+0000","last_clean":"2024-04-26T07:30:17.377065+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:30:17.377065+0000","last_undegraded":"2024-04-26T07:30:17.377065+0000","last_fullsized":"2024-04-26T07:30:17.377065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_clean_scrub_stamp":"2024-04-26T07:30:17.377064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.414289+0000","last_change":"2024-04-26T07:30:11.414367+0000","last_active":"2024-04-26T07:30:11.414289+0000","last_peered":"2024-04-26T07:30:11.414289+0000","last_clean":"2024-04-26T07:30:11.414289+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:30:11.414289+0000","last_undegraded":"2024-04-26T07:30:11.414289+0000","last_fullsized":"2024-04-26T07:30:11.414289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.414288+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:19.136227+0000","last_change":"2024-04-26T07:30:19.136319+0000","last_active":"2024-04-26T07:30:19.136227+0000","last_peered":"2024-04-26T07:30:19.136227+0000","last_clean":"2024-04-26T07:30:19.136227+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:30:19.136227+0000","last_undegraded":"2024-04-26T07:30:19.136227+0000","last_fullsized":"2024-04-26T07:30:19.136227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:19.136226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'12","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:29.574126+0000","last_change":"2024-04-26T07:30:29.574207+0000","last_active":"2024-04-26T07:30:29.574126+0000","last_peered":"2024-04-26T07:30:29.574126+0000","last_clean":"2024-04-26T07:30:29.574126+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:30:29.574126+0000","last_undegraded":"2024-04-26T07:30:29.574126+0000","last_fullsized":"2024-04-26T07:30:29.574126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_clean_scrub_stamp":"2024-04-26T07:30:29.574125+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:39.295620+0000","last_change":"2024-04-26T07:30:39.295711+0000","last_active":"2024-04-26T07:30:39.295620+0000","last_peered":"2024-04-26T07:30:39.295620+0000","last_clean":"2024-04-26T07:30:39.295620+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:30:39.295620+0000","last_undegraded":"2024-04-26T07:30:39.295620+0000","last_fullsized":"2024-04-26T07:30:39.295620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_clean_scrub_stamp":"2024-04-26T07:30:39.295619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.788374+0000","last_change":"2024-04-26T07:30:27.788453+0000","last_active":"2024-04-26T07:30:27.788374+0000","last_peered":"2024-04-26T07:30:27.788374+0000","last_clean":"2024-04-26T07:30:27.788374+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:30:27.788374+0000","last_undegraded":"2024-04-26T07:30:27.788374+0000","last_fullsized":"2024-04-26T07:30:27.788374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.788374+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:36.226727+0000","last_change":"2024-04-26T07:30:36.226816+0000","last_active":"2024-04-26T07:30:36.226727+0000","last_peered":"2024-04-26T07:30:36.226727+0000","last_clean":"2024-04-26T07:30:36.226727+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:30:36.226727+0000","last_undegraded":"2024-04-26T07:30:36.226727+0000","last_fullsized":"2024-04-26T07:30:36.226727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_clean_scrub_stamp":"2024-04-26T07:30:36.226726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:11.969596+0000","last_change":"2024-04-26T07:31:11.969715+0000","last_active":"2024-04-26T07:31:11.969596+0000","last_peered":"2024-04-26T07:31:11.969596+0000","last_clean":"2024-04-26T07:31:11.969596+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:31:11.969596+0000","last_undegraded":"2024-04-26T07:31:11.969596+0000","last_fullsized":"2024-04-26T07:31:11.969596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:31:11.969596+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:31:11.969596+0000","last_clean_scrub_stamp":"2024-04-26T07:31:11.969596+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.249230+0000","last_change":"2024-04-26T07:30:32.249320+0000","last_active":"2024-04-26T07:30:32.249230+0000","last_peered":"2024-04-26T07:30:32.249230+0000","last_clean":"2024-04-26T07:30:32.249230+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:30:32.249230+0000","last_undegraded":"2024-04-26T07:30:32.249230+0000","last_fullsized":"2024-04-26T07:30:32.249230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.249230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:18.959835+0000","last_change":"2024-04-26T07:31:18.959927+0000","last_active":"2024-04-26T07:31:18.959835+0000","last_peered":"2024-04-26T07:31:18.959835+0000","last_clean":"2024-04-26T07:31:18.959835+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:31:18.959835+0000","last_undegraded":"2024-04-26T07:31:18.959835+0000","last_fullsized":"2024-04-26T07:31:18.959835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:31:18.959834+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:31:18.959834+0000","last_clean_scrub_stamp":"2024-04-26T07:31:18.959834+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.561764+0000","last_change":"2024-04-26T07:30:31.561845+0000","last_active":"2024-04-26T07:30:31.561764+0000","last_peered":"2024-04-26T07:30:31.561764+0000","last_clean":"2024-04-26T07:30:31.561764+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:30:31.561764+0000","last_undegraded":"2024-04-26T07:30:31.561764+0000","last_fullsized":"2024-04-26T07:30:31.561764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.561764+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.216511+0000","last_change":"2024-04-26T07:30:31.216609+0000","last_active":"2024-04-26T07:30:31.216511+0000","last_peered":"2024-04-26T07:30:31.216511+0000","last_clean":"2024-04-26T07:30:31.216511+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:30:31.216511+0000","last_undegraded":"2024-04-26T07:30:31.216511+0000","last_fullsized":"2024-04-26T07:30:31.216511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.216510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.967952+0000","last_change":"2024-04-26T07:30:44.968081+0000","last_active":"2024-04-26T07:30:44.967952+0000","last_peered":"2024-04-26T07:30:44.967952+0000","last_clean":"2024-04-26T07:30:44.967952+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:30:44.967952+0000","last_undegraded":"2024-04-26T07:30:44.967952+0000","last_fullsized":"2024-04-26T07:30:44.967952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.967951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.450558+0000","last_change":"2024-04-26T07:30:50.450657+0000","last_active":"2024-04-26T07:30:50.450558+0000","last_peered":"2024-04-26T07:30:50.450558+0000","last_clean":"2024-04-26T07:30:50.450558+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:30:50.450558+0000","last_undegraded":"2024-04-26T07:30:50.450558+0000","last_fullsized":"2024-04-26T07:30:50.450558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.450557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:46.936609+0000","last_change":"2024-04-26T07:30:46.936704+0000","last_active":"2024-04-26T07:30:46.936609+0000","last_peered":"2024-04-26T07:30:46.936609+0000","last_clean":"2024-04-26T07:30:46.936609+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:30:46.936609+0000","last_undegraded":"2024-04-26T07:30:46.936609+0000","last_fullsized":"2024-04-26T07:30:46.936609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_clean_scrub_stamp":"2024-04-26T07:30:46.936608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705704,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.27900000000000003,"15min":0.27000000000000002},"min":{"1min":0.21199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.30299999999999999,"15min":0.29899999999999999},"min":{"1min":0.215,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.28699999999999998}]},{"osd":1,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.313,"15min":0.308},"min":{"1min":0.21199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.31,"15min":0.30599999999999999},"min":{"1min":0.23799999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.371},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.317,"15min":0.313},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.311}]}]},{"osd":2,"up_from":9,"seq":38654705705,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.28999999999999998,"15min":0.28699999999999998},"min":{"1min":0.222,"5min":0.16,"15min":0.16},"max":{"1min":0.41999999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.308},"min":{"1min":0.22800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.432,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.498,"5min":0.503,"15min":0.503},"last":0.312},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.34799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.28799999999999998,"15min":0.27300000000000002},"min":{"1min":0.26900000000000002,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.45000000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.29199999999999998},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.47299999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.432}]},{"osd":2,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.32500000000000001,"15min":0.315},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.32500000000000001,"15min":0.313},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.318},"min":{"1min":0.29799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.26400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.45000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.496}]}]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.29999999999999999},"min":{"1min":0.23599999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.439,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.32100000000000001},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48299999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.33700000000000002},"min":{"1min":0.249,"5min":0.193,"15min":0.193},"max":{"1min":0.47999999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.316},{"interface":"front","average":{"1min":0.38,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.46400000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.23300000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.49199999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.27400000000000002}]}]}]}} 2024-04-26T07:31:29.749 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.750 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.750 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.750 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.751 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.751 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.751 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.751 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.751 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.752 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.752 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.752 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.752 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.752 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.753 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.753 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.753 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.754 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.754 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:29.754 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:31:49.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:31:49.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.877+0000 7fe907fdd700 1 Processor -- start 2024-04-26T07:31:49.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.877+0000 7fe907fdd700 1 -- start start 2024-04-26T07:31:49.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe907fdd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:49.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe907fdd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe900133340 0x7fe9001337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:49.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe907fdd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90006cd70 con 0x7fe9000648b0 2024-04-26T07:31:49.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe907fdd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe900137340 con 0x7fe900133340 2024-04-26T07:31:49.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe907fdd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe900132eb0 con 0x7fe90006c990 2024-04-26T07:31:49.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe905578700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe9000648b0 0x7fe900136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48336/0 (socket says 172.21.15.31:48336) 2024-04-26T07:31:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe905d79700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe90657a700 1 --2- 172.21.15.31:0/1186925323 >> v2:172.21.15.31:3300/0 conn(0x7fe900133340 0x7fe9001337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe905578700 1 -- 172.21.15.31:0/1186925323 learned_addr learned my addr 172.21.15.31:0/1186925323 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:31:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe905d79700 1 -- 172.21.15.31:0/1186925323 >> v2:172.21.15.31:3300/0 conn(0x7fe900133340 msgr2=0x7fe9001337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:31:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe905d79700 1 --2- 172.21.15.31:0/1186925323 >> v2:172.21.15.31:3300/0 conn(0x7fe900133340 0x7fe9001337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe905d79700 1 -- 172.21.15.31:0/1186925323 >> v1:172.21.15.31:6789/0 conn(0x7fe9000648b0 legacy=0x7fe900136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe905d79700 1 -- 172.21.15.31:0/1186925323 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900063c00 con 0x7fe90006c990 2024-04-26T07:31:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe90657a700 1 --2- 172.21.15.31:0/1186925323 >> v2:172.21.15.31:3300/0 conn(0x7fe900133340 0x7fe9001337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:31:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.878+0000 7fe905d79700 1 --2- 172.21.15.31:0/1186925323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900136400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe9000a9bc0 tx=0x7fe8f0006df0).ready entity=mon.1 client_cookie=3cd10d478e3a707f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:31:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe904d77700 1 -- 172.21.15.31:0/1186925323 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f000d570 con 0x7fe90006c990 2024-04-26T07:31:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe904d77700 1 -- 172.21.15.31:0/1186925323 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f0000e90 con 0x7fe90006c990 2024-04-26T07:31:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe904d77700 1 -- 172.21.15.31:0/1186925323 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f000d8c0 con 0x7fe90006c990 2024-04-26T07:31:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe907fdd700 1 -- 172.21.15.31:0/1186925323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 msgr2=0x7fe900136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe907fdd700 1 --2- 172.21.15.31:0/1186925323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900136400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe9000a9bc0 tx=0x7fe8f0006df0).stop 2024-04-26T07:31:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe907fdd700 1 -- 172.21.15.31:0/1186925323 shutdown_connections 2024-04-26T07:31:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe907fdd700 1 --2- 172.21.15.31:0/1186925323 >> v2:172.21.15.31:3300/0 conn(0x7fe900133340 0x7fe9001337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe907fdd700 1 --2- 172.21.15.31:0/1186925323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900136400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe907fdd700 1 -- 172.21.15.31:0/1186925323 >> 172.21.15.31:0/1186925323 conn(0x7fe900061370 msgr2=0x7fe90006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:31:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe907fdd700 1 -- 172.21.15.31:0/1186925323 shutdown_connections 2024-04-26T07:31:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.879+0000 7fe907fdd700 1 -- 172.21.15.31:0/1186925323 wait complete. 2024-04-26T07:31:49.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.880+0000 7fe907fdd700 1 Processor -- start 2024-04-26T07:31:49.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.880+0000 7fe907fdd700 1 -- start start 2024-04-26T07:31:49.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.881+0000 7fe907fdd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9000648b0 0x7fe900138220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:49.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.881+0000 7fe907fdd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:49.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.881+0000 7fe907fdd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe900133340 0x7fe900147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:31:49.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.881+0000 7fe907fdd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe900139960 con 0x7fe900133340 2024-04-26T07:31:49.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.881+0000 7fe907fdd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe900066020 con 0x7fe90006c990 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.881+0000 7fe907fdd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe900066250 con 0x7fe9000648b0 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.881+0000 7fe905d79700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9000648b0 0x7fe900138220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905d79700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9000648b0 0x7fe900138220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:39786/0 (socket says 172.21.15.31:39786) 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905d79700 1 -- 172.21.15.31:0/433149077 learned_addr learned my addr 172.21.15.31:0/433149077 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe90657a700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe900133340 0x7fe900147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905578700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905d79700 1 -- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 msgr2=0x7fe900146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905d79700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905d79700 1 -- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe900133340 msgr2=0x7fe900147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905d79700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe900133340 0x7fe900147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905d79700 1 -- 172.21.15.31:0/433149077 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8009470 con 0x7fe9000648b0 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe90657a700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe900133340 0x7fe900147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe905d79700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9000648b0 0x7fe900138220 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe9000681a0 tx=0x7fe8f0014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe8eeffd700 1 -- 172.21.15.31:0/433149077 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f0013e40 con 0x7fe9000648b0 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe8eeffd700 1 -- 172.21.15.31:0/433149077 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f0002f70 con 0x7fe9000648b0 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f000b180 con 0x7fe9000648b0 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe8eeffd700 1 -- 172.21.15.31:0/433149077 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f001e5f0 con 0x7fe9000648b0 2024-04-26T07:31:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.882+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe900067900 con 0x7fe9000648b0 2024-04-26T07:31:49.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.883+0000 7fe8eeffd700 1 -- 172.21.15.31:0/433149077 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe8f0025030 con 0x7fe9000648b0 2024-04-26T07:31:49.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.883+0000 7fe8eeffd700 1 -- 172.21.15.31:0/433149077 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe8f004b800 con 0x7fe9000648b0 2024-04-26T07:31:49.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.884+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9001392f0 con 0x7fe9000648b0 2024-04-26T07:31:49.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.887+0000 7fe8eeffd700 1 -- 172.21.15.31:0/433149077 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe8f0013120 con 0x7fe9000648b0 2024-04-26T07:31:49.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:49.999+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe90006bbc0 con 0x7fe8e0038f50 2024-04-26T07:31:50.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.006+0000 7fe8eeffd700 1 -- 172.21.15.31:0/433149077 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252214 (unknown 2965378022 0 1969577895) 0x7fe90006bbc0 con 0x7fe8e0038f50 2024-04-26T07:31:50.010 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:31:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 >> v1:172.21.15.31:6816/39613 conn(0x7fe8e0038f50 legacy=0x7fe8e003b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9000648b0 msgr2=0x7fe900138220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:31:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9000648b0 0x7fe900138220 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe9000681a0 tx=0x7fe8f0014000).stop 2024-04-26T07:31:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 shutdown_connections 2024-04-26T07:31:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9000648b0 0x7fe900138220 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe900133340 0x7fe900147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 --2- 172.21.15.31:0/433149077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe90006c990 0x7fe900146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:31:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 >> 172.21.15.31:0/433149077 conn(0x7fe900061370 msgr2=0x7fe900099ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:31:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 shutdown_connections 2024-04-26T07:31:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:31:50.009+0000 7fe907fdd700 1 -- 172.21.15.31:0/433149077 wait complete. 2024-04-26T07:31:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:31:50.019 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-04-26T07:31:48.020361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13536,"num_omap_keys":21,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.426802+0000","last_change":"2024-04-26T07:30:52.426911+0000","last_active":"2024-04-26T07:30:52.426802+0000","last_peered":"2024-04-26T07:30:52.426802+0000","last_clean":"2024-04-26T07:30:52.426802+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:30:52.426802+0000","last_undegraded":"2024-04-26T07:30:52.426802+0000","last_fullsized":"2024-04-26T07:30:52.426802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.426801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.387022+0000","last_change":"2024-04-26T07:30:51.387112+0000","last_active":"2024-04-26T07:30:51.387022+0000","last_peered":"2024-04-26T07:30:51.387022+0000","last_clean":"2024-04-26T07:30:51.387022+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:30:51.387022+0000","last_undegraded":"2024-04-26T07:30:51.387022+0000","last_fullsized":"2024-04-26T07:30:51.387022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.387021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:17.334912+0000","last_change":"2024-04-26T07:31:17.335002+0000","last_active":"2024-04-26T07:31:17.334912+0000","last_peered":"2024-04-26T07:31:17.334912+0000","last_clean":"2024-04-26T07:31:17.334912+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:31:17.334912+0000","last_undegraded":"2024-04-26T07:31:17.334912+0000","last_fullsized":"2024-04-26T07:31:17.334912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:17.334911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:17.334911+0000","last_clean_scrub_stamp":"2024-04-26T07:31:17.334911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:16.290874+0000","last_change":"2024-04-26T07:31:16.290972+0000","last_active":"2024-04-26T07:31:16.290874+0000","last_peered":"2024-04-26T07:31:16.290874+0000","last_clean":"2024-04-26T07:31:16.290874+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:31:16.290874+0000","last_undegraded":"2024-04-26T07:31:16.290874+0000","last_fullsized":"2024-04-26T07:31:16.290874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:16.290873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:16.290873+0000","last_clean_scrub_stamp":"2024-04-26T07:31:16.290873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:13.357195+0000","last_change":"2024-04-26T07:31:13.357281+0000","last_active":"2024-04-26T07:31:13.357195+0000","last_peered":"2024-04-26T07:31:13.357195+0000","last_clean":"2024-04-26T07:31:13.357195+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:31:13.357195+0000","last_undegraded":"2024-04-26T07:31:13.357195+0000","last_fullsized":"2024-04-26T07:31:13.357195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:13.357195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:13.357195+0000","last_clean_scrub_stamp":"2024-04-26T07:31:13.357195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:12.068148+0000","last_change":"2024-04-26T07:31:12.068229+0000","last_active":"2024-04-26T07:31:12.068148+0000","last_peered":"2024-04-26T07:31:12.068148+0000","last_clean":"2024-04-26T07:31:12.068148+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:31:12.068148+0000","last_undegraded":"2024-04-26T07:31:12.068148+0000","last_fullsized":"2024-04-26T07:31:12.068148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:12.068147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:12.068147+0000","last_clean_scrub_stamp":"2024-04-26T07:31:12.068147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:12.351167+0000","last_change":"2024-04-26T07:31:12.351287+0000","last_active":"2024-04-26T07:31:12.351167+0000","last_peered":"2024-04-26T07:31:12.351167+0000","last_clean":"2024-04-26T07:31:12.351167+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:31:12.351167+0000","last_undegraded":"2024-04-26T07:31:12.351167+0000","last_fullsized":"2024-04-26T07:31:12.351167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:12.351167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:12.351167+0000","last_clean_scrub_stamp":"2024-04-26T07:31:12.351167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.047204+0000","last_change":"2024-04-26T07:31:06.047291+0000","last_active":"2024-04-26T07:31:06.047204+0000","last_peered":"2024-04-26T07:31:06.047204+0000","last_clean":"2024-04-26T07:31:06.047204+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:31:06.047204+0000","last_undegraded":"2024-04-26T07:31:06.047204+0000","last_fullsized":"2024-04-26T07:31:06.047204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.047203+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:04.079986+0000","last_change":"2024-04-26T07:31:04.080077+0000","last_active":"2024-04-26T07:31:04.079986+0000","last_peered":"2024-04-26T07:31:04.079986+0000","last_clean":"2024-04-26T07:31:04.079986+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:31:04.079986+0000","last_undegraded":"2024-04-26T07:31:04.079986+0000","last_fullsized":"2024-04-26T07:31:04.079986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_clean_scrub_stamp":"2024-04-26T07:31:04.079985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:47.333000+0000","last_change":"2024-04-26T07:30:47.333131+0000","last_active":"2024-04-26T07:30:47.333000+0000","last_peered":"2024-04-26T07:30:47.333000+0000","last_clean":"2024-04-26T07:30:47.333000+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:30:47.333000+0000","last_undegraded":"2024-04-26T07:30:47.333000+0000","last_fullsized":"2024-04-26T07:30:47.333000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_clean_scrub_stamp":"2024-04-26T07:30:47.333000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.307226+0000","last_change":"2024-04-26T07:30:42.307331+0000","last_active":"2024-04-26T07:30:42.307226+0000","last_peered":"2024-04-26T07:30:42.307226+0000","last_clean":"2024-04-26T07:30:42.307226+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:30:42.307226+0000","last_undegraded":"2024-04-26T07:30:42.307226+0000","last_fullsized":"2024-04-26T07:30:42.307226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.307226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:00.092689+0000","last_change":"2024-04-26T07:31:00.092776+0000","last_active":"2024-04-26T07:31:00.092689+0000","last_peered":"2024-04-26T07:31:00.092689+0000","last_clean":"2024-04-26T07:31:00.092689+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:31:00.092689+0000","last_undegraded":"2024-04-26T07:31:00.092689+0000","last_fullsized":"2024-04-26T07:31:00.092689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_clean_scrub_stamp":"2024-04-26T07:31:00.092689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:10.341169+0000","last_change":"2024-04-26T07:31:10.341266+0000","last_active":"2024-04-26T07:31:10.341169+0000","last_peered":"2024-04-26T07:31:10.341169+0000","last_clean":"2024-04-26T07:31:10.341169+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:31:10.341169+0000","last_undegraded":"2024-04-26T07:31:10.341169+0000","last_fullsized":"2024-04-26T07:31:10.341169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:10.341168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:10.341168+0000","last_clean_scrub_stamp":"2024-04-26T07:31:10.341168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.307189+0000","last_change":"2024-04-26T07:31:06.307276+0000","last_active":"2024-04-26T07:31:06.307189+0000","last_peered":"2024-04-26T07:31:06.307189+0000","last_clean":"2024-04-26T07:31:06.307189+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:31:06.307189+0000","last_undegraded":"2024-04-26T07:31:06.307189+0000","last_fullsized":"2024-04-26T07:31:06.307189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.307188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:59.385202+0000","last_change":"2024-04-26T07:30:59.385291+0000","last_active":"2024-04-26T07:30:59.385202+0000","last_peered":"2024-04-26T07:30:59.385202+0000","last_clean":"2024-04-26T07:30:59.385202+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:30:59.385202+0000","last_undegraded":"2024-04-26T07:30:59.385202+0000","last_fullsized":"2024-04-26T07:30:59.385202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_clean_scrub_stamp":"2024-04-26T07:30:59.385201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:40.294718+0000","last_change":"2024-04-26T07:30:40.294811+0000","last_active":"2024-04-26T07:30:40.294718+0000","last_peered":"2024-04-26T07:30:40.294718+0000","last_clean":"2024-04-26T07:30:40.294718+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:30:40.294718+0000","last_undegraded":"2024-04-26T07:30:40.294718+0000","last_fullsized":"2024-04-26T07:30:40.294718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_clean_scrub_stamp":"2024-04-26T07:30:40.294717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.022023+0000","last_change":"2024-04-26T07:30:56.022116+0000","last_active":"2024-04-26T07:30:56.022023+0000","last_peered":"2024-04-26T07:30:56.022023+0000","last_clean":"2024-04-26T07:30:56.022023+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:30:56.022023+0000","last_undegraded":"2024-04-26T07:30:56.022023+0000","last_fullsized":"2024-04-26T07:30:56.022023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.022022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:55.027604+0000","last_change":"2024-04-26T07:30:55.027705+0000","last_active":"2024-04-26T07:30:55.027604+0000","last_peered":"2024-04-26T07:30:55.027604+0000","last_clean":"2024-04-26T07:30:55.027604+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:30:55.027604+0000","last_undegraded":"2024-04-26T07:30:55.027604+0000","last_fullsized":"2024-04-26T07:30:55.027604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_clean_scrub_stamp":"2024-04-26T07:30:55.027603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.447536+0000","last_change":"2024-04-26T07:30:52.447634+0000","last_active":"2024-04-26T07:30:52.447536+0000","last_peered":"2024-04-26T07:30:52.447536+0000","last_clean":"2024-04-26T07:30:52.447536+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:30:52.447536+0000","last_undegraded":"2024-04-26T07:30:52.447536+0000","last_fullsized":"2024-04-26T07:30:52.447536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.447536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.174751+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:54.059185+0000","last_change":"2024-04-26T07:30:54.059310+0000","last_active":"2024-04-26T07:30:54.059185+0000","last_peered":"2024-04-26T07:30:54.059185+0000","last_clean":"2024-04-26T07:30:54.059185+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:30:54.059185+0000","last_undegraded":"2024-04-26T07:30:54.059185+0000","last_fullsized":"2024-04-26T07:30:54.059185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_clean_scrub_stamp":"2024-04-26T07:30:54.059185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:53.020287+0000","last_change":"2024-04-26T07:30:53.020393+0000","last_active":"2024-04-26T07:30:53.020287+0000","last_peered":"2024-04-26T07:30:53.020287+0000","last_clean":"2024-04-26T07:30:53.020287+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:30:53.020287+0000","last_undegraded":"2024-04-26T07:30:53.020287+0000","last_fullsized":"2024-04-26T07:30:53.020287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_clean_scrub_stamp":"2024-04-26T07:30:53.020286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.976317+0000","last_change":"2024-04-26T07:30:50.976414+0000","last_active":"2024-04-26T07:30:50.976317+0000","last_peered":"2024-04-26T07:30:50.976317+0000","last_clean":"2024-04-26T07:30:50.976317+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:30:50.976317+0000","last_undegraded":"2024-04-26T07:30:50.976317+0000","last_fullsized":"2024-04-26T07:30:50.976317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.976316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139678+0000","last_change":"2024-04-26T07:28:31.174736+0000","last_active":"2024-04-26T07:28:32.139678+0000","last_peered":"2024-04-26T07:28:32.139678+0000","last_clean":"2024-04-26T07:28:32.139678+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:28:32.139678+0000","last_undegraded":"2024-04-26T07:28:32.139678+0000","last_fullsized":"2024-04-26T07:28:32.139678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.890710+0000","last_change":"2024-04-26T07:30:23.890791+0000","last_active":"2024-04-26T07:30:23.890710+0000","last_peered":"2024-04-26T07:30:23.890710+0000","last_clean":"2024-04-26T07:30:23.890710+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:30:23.890710+0000","last_undegraded":"2024-04-26T07:30:23.890710+0000","last_fullsized":"2024-04-26T07:30:23.890710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.890710+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139796+0000","last_change":"2024-04-26T07:28:31.173696+0000","last_active":"2024-04-26T07:28:32.139796+0000","last_peered":"2024-04-26T07:28:32.139796+0000","last_clean":"2024-04-26T07:28:32.139796+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:28:32.139796+0000","last_undegraded":"2024-04-26T07:28:32.139796+0000","last_fullsized":"2024-04-26T07:28:32.139796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:22.844919+0000","last_change":"2024-04-26T07:30:22.845011+0000","last_active":"2024-04-26T07:30:22.844919+0000","last_peered":"2024-04-26T07:30:22.844919+0000","last_clean":"2024-04-26T07:30:22.844919+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:30:22.844919+0000","last_undegraded":"2024-04-26T07:30:22.844919+0000","last_fullsized":"2024-04-26T07:30:22.844919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_clean_scrub_stamp":"2024-04-26T07:30:22.844919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.440808+0000","last_change":"2024-04-26T07:30:44.440891+0000","last_active":"2024-04-26T07:30:44.440808+0000","last_peered":"2024-04-26T07:30:44.440808+0000","last_clean":"2024-04-26T07:30:44.440808+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:30:44.440808+0000","last_undegraded":"2024-04-26T07:30:44.440808+0000","last_fullsized":"2024-04-26T07:30:44.440808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.440807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:08.046243+0000","last_change":"2024-04-26T07:31:08.046335+0000","last_active":"2024-04-26T07:31:08.046243+0000","last_peered":"2024-04-26T07:31:08.046243+0000","last_clean":"2024-04-26T07:31:08.046243+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:31:08.046243+0000","last_undegraded":"2024-04-26T07:31:08.046243+0000","last_fullsized":"2024-04-26T07:31:08.046243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:31:08.046243+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:31:08.046243+0000","last_clean_scrub_stamp":"2024-04-26T07:31:08.046243+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139883+0000","last_change":"2024-04-26T07:28:31.172904+0000","last_active":"2024-04-26T07:28:32.139883+0000","last_peered":"2024-04-26T07:28:32.139883+0000","last_clean":"2024-04-26T07:28:32.139883+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:28:32.139883+0000","last_undegraded":"2024-04-26T07:28:32.139883+0000","last_fullsized":"2024-04-26T07:28:32.139883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'9","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.580238+0000","last_change":"2024-04-26T07:30:25.580325+0000","last_active":"2024-04-26T07:30:25.580238+0000","last_peered":"2024-04-26T07:30:25.580238+0000","last_clean":"2024-04-26T07:30:25.580238+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:30:25.580238+0000","last_undegraded":"2024-04-26T07:30:25.580238+0000","last_fullsized":"2024-04-26T07:30:25.580238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'9","last_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_deep_scrub":"19'9","last_deep_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.580237+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:37.906762+0000","last_change":"2024-04-26T07:31:37.906853+0000","last_active":"2024-04-26T07:31:37.906762+0000","last_peered":"2024-04-26T07:31:37.906762+0000","last_clean":"2024-04-26T07:31:37.906762+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:31:37.906762+0000","last_undegraded":"2024-04-26T07:31:37.906762+0000","last_fullsized":"2024-04-26T07:31:37.906762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:37.906761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:37.906761+0000","last_clean_scrub_stamp":"2024-04-26T07:31:37.906761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.163184+0000","last_change":"2024-04-26T07:30:15.163266+0000","last_active":"2024-04-26T07:30:15.163184+0000","last_peered":"2024-04-26T07:30:15.163184+0000","last_clean":"2024-04-26T07:30:15.163184+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:30:15.163184+0000","last_undegraded":"2024-04-26T07:30:15.163184+0000","last_fullsized":"2024-04-26T07:30:15.163184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.163183+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:38.869746+0000","last_change":"2024-04-26T07:31:38.869839+0000","last_active":"2024-04-26T07:31:38.869746+0000","last_peered":"2024-04-26T07:31:38.869746+0000","last_clean":"2024-04-26T07:31:38.869746+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:31:38.869746+0000","last_undegraded":"2024-04-26T07:31:38.869746+0000","last_fullsized":"2024-04-26T07:31:38.869746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:38.869746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:38.869746+0000","last_clean_scrub_stamp":"2024-04-26T07:31:38.869746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.570415+0000","last_change":"2024-04-26T07:30:23.570499+0000","last_active":"2024-04-26T07:30:23.570415+0000","last_peered":"2024-04-26T07:30:23.570415+0000","last_clean":"2024-04-26T07:30:23.570415+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:30:23.570415+0000","last_undegraded":"2024-04-26T07:30:23.570415+0000","last_fullsized":"2024-04-26T07:30:23.570415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.570415+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.011724+0000","last_change":"2024-04-26T07:30:44.011821+0000","last_active":"2024-04-26T07:30:44.011724+0000","last_peered":"2024-04-26T07:30:44.011724+0000","last_clean":"2024-04-26T07:30:44.011724+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:30:44.011724+0000","last_undegraded":"2024-04-26T07:30:44.011724+0000","last_fullsized":"2024-04-26T07:30:44.011724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.011723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'21","reported_seq":35,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:07.012832+0000","last_change":"2024-04-26T07:31:07.012911+0000","last_active":"2024-04-26T07:31:07.012832+0000","last_peered":"2024-04-26T07:31:07.012832+0000","last_clean":"2024-04-26T07:31:07.012832+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:31:07.012832+0000","last_undegraded":"2024-04-26T07:31:07.012832+0000","last_fullsized":"2024-04-26T07:31:07.012832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'21","last_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_deep_scrub":"19'21","last_deep_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_clean_scrub_stamp":"2024-04-26T07:31:07.012831+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.232011+0000","last_change":"2024-04-26T07:30:27.232105+0000","last_active":"2024-04-26T07:30:27.232011+0000","last_peered":"2024-04-26T07:30:27.232011+0000","last_clean":"2024-04-26T07:30:27.232011+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:30:27.232011+0000","last_undegraded":"2024-04-26T07:30:27.232011+0000","last_fullsized":"2024-04-26T07:30:27.232011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.232010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:01.928484+0000","last_change":"2024-04-26T07:31:01.928571+0000","last_active":"2024-04-26T07:31:01.928484+0000","last_peered":"2024-04-26T07:31:01.928484+0000","last_clean":"2024-04-26T07:31:01.928484+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:31:01.928484+0000","last_undegraded":"2024-04-26T07:31:01.928484+0000","last_fullsized":"2024-04-26T07:31:01.928484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_clean_scrub_stamp":"2024-04-26T07:31:01.928484+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:43.892447+0000","last_change":"2024-04-26T07:31:43.892541+0000","last_active":"2024-04-26T07:31:43.892447+0000","last_peered":"2024-04-26T07:31:43.892447+0000","last_clean":"2024-04-26T07:31:43.892447+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:31:43.892447+0000","last_undegraded":"2024-04-26T07:31:43.892447+0000","last_fullsized":"2024-04-26T07:31:43.892447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:43.892447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:43.892447+0000","last_clean_scrub_stamp":"2024-04-26T07:31:43.892447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:21.505390+0000","last_change":"2024-04-26T07:30:21.505470+0000","last_active":"2024-04-26T07:30:21.505390+0000","last_peered":"2024-04-26T07:30:21.505390+0000","last_clean":"2024-04-26T07:30:21.505390+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:30:21.505390+0000","last_undegraded":"2024-04-26T07:30:21.505390+0000","last_fullsized":"2024-04-26T07:30:21.505390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_clean_scrub_stamp":"2024-04-26T07:30:21.505390+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:45.872604+0000","last_change":"2024-04-26T07:31:45.872739+0000","last_active":"2024-04-26T07:31:45.872604+0000","last_peered":"2024-04-26T07:31:45.872604+0000","last_clean":"2024-04-26T07:31:45.872604+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:31:45.872604+0000","last_undegraded":"2024-04-26T07:31:45.872604+0000","last_fullsized":"2024-04-26T07:31:45.872604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:45.872603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:45.872603+0000","last_clean_scrub_stamp":"2024-04-26T07:31:45.872603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.845651+0000","last_change":"2024-04-26T07:30:56.845747+0000","last_active":"2024-04-26T07:30:56.845651+0000","last_peered":"2024-04-26T07:30:56.845651+0000","last_clean":"2024-04-26T07:30:56.845651+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:30:56.845651+0000","last_undegraded":"2024-04-26T07:30:56.845651+0000","last_fullsized":"2024-04-26T07:30:56.845651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.845650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.427936+0000","last_change":"2024-04-26T07:30:42.428022+0000","last_active":"2024-04-26T07:30:42.427936+0000","last_peered":"2024-04-26T07:30:42.427936+0000","last_clean":"2024-04-26T07:30:42.427936+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:30:42.427936+0000","last_undegraded":"2024-04-26T07:30:42.427936+0000","last_fullsized":"2024-04-26T07:30:42.427936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.427935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'15","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:18.834721+0000","last_change":"2024-04-26T07:30:18.834800+0000","last_active":"2024-04-26T07:30:18.834721+0000","last_peered":"2024-04-26T07:30:18.834721+0000","last_clean":"2024-04-26T07:30:18.834721+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:30:18.834721+0000","last_undegraded":"2024-04-26T07:30:18.834721+0000","last_fullsized":"2024-04-26T07:30:18.834721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'15","last_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_deep_scrub":"19'15","last_deep_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_clean_scrub_stamp":"2024-04-26T07:30:18.834720+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:47.891030+0000","last_change":"2024-04-26T07:31:47.891117+0000","last_active":"2024-04-26T07:31:47.891030+0000","last_peered":"2024-04-26T07:31:47.891030+0000","last_clean":"2024-04-26T07:31:47.891030+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:31:47.891030+0000","last_undegraded":"2024-04-26T07:31:47.891030+0000","last_fullsized":"2024-04-26T07:31:47.891030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:47.891030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:47.891030+0000","last_clean_scrub_stamp":"2024-04-26T07:31:47.891030+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.546240+0000","last_change":"2024-04-26T07:30:20.546354+0000","last_active":"2024-04-26T07:30:20.546240+0000","last_peered":"2024-04-26T07:30:20.546240+0000","last_clean":"2024-04-26T07:30:20.546240+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:30:20.546240+0000","last_undegraded":"2024-04-26T07:30:20.546240+0000","last_fullsized":"2024-04-26T07:30:20.546240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.546239+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:30.819563+0000","last_change":"2024-04-26T07:31:30.819662+0000","last_active":"2024-04-26T07:31:30.819563+0000","last_peered":"2024-04-26T07:31:30.819563+0000","last_clean":"2024-04-26T07:31:30.819563+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:31:30.819563+0000","last_undegraded":"2024-04-26T07:31:30.819563+0000","last_fullsized":"2024-04-26T07:31:30.819563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:30.819563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:30.819563+0000","last_clean_scrub_stamp":"2024-04-26T07:31:30.819563+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:13.068833+0000","last_change":"2024-04-26T07:30:13.068913+0000","last_active":"2024-04-26T07:30:13.068833+0000","last_peered":"2024-04-26T07:30:13.068833+0000","last_clean":"2024-04-26T07:30:13.068833+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:30:13.068833+0000","last_undegraded":"2024-04-26T07:30:13.068833+0000","last_fullsized":"2024-04-26T07:30:13.068833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:13.068832+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.955449+0000","last_change":"2024-04-26T07:30:38.955557+0000","last_active":"2024-04-26T07:30:38.955449+0000","last_peered":"2024-04-26T07:30:38.955449+0000","last_clean":"2024-04-26T07:30:38.955449+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:30:38.955449+0000","last_undegraded":"2024-04-26T07:30:38.955449+0000","last_fullsized":"2024-04-26T07:30:38.955449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.955449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.700832+0000","last_change":"2024-04-26T07:30:51.700910+0000","last_active":"2024-04-26T07:30:51.700832+0000","last_peered":"2024-04-26T07:30:51.700832+0000","last_clean":"2024-04-26T07:30:51.700832+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:30:51.700832+0000","last_undegraded":"2024-04-26T07:30:51.700832+0000","last_fullsized":"2024-04-26T07:30:51.700832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.700832+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.148236+0000","last_change":"2024-04-26T07:30:20.148325+0000","last_active":"2024-04-26T07:30:20.148236+0000","last_peered":"2024-04-26T07:30:20.148236+0000","last_clean":"2024-04-26T07:30:20.148236+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:30:20.148236+0000","last_undegraded":"2024-04-26T07:30:20.148236+0000","last_fullsized":"2024-04-26T07:30:20.148236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.148235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.511807+0000","last_change":"2024-04-26T07:30:16.511900+0000","last_active":"2024-04-26T07:30:16.511807+0000","last_peered":"2024-04-26T07:30:16.511807+0000","last_clean":"2024-04-26T07:30:16.511807+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:30:16.511807+0000","last_undegraded":"2024-04-26T07:30:16.511807+0000","last_fullsized":"2024-04-26T07:30:16.511807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.511806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:34.479850+0000","last_change":"2024-04-26T07:30:34.479942+0000","last_active":"2024-04-26T07:30:34.479850+0000","last_peered":"2024-04-26T07:30:34.479850+0000","last_clean":"2024-04-26T07:30:34.479850+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:30:34.479850+0000","last_undegraded":"2024-04-26T07:30:34.479850+0000","last_fullsized":"2024-04-26T07:30:34.479850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_clean_scrub_stamp":"2024-04-26T07:30:34.479849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:49.675793+0000","last_change":"2024-04-26T07:30:49.675867+0000","last_active":"2024-04-26T07:30:49.675793+0000","last_peered":"2024-04-26T07:30:49.675793+0000","last_clean":"2024-04-26T07:30:49.675793+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:30:49.675793+0000","last_undegraded":"2024-04-26T07:30:49.675793+0000","last_fullsized":"2024-04-26T07:30:49.675793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_clean_scrub_stamp":"2024-04-26T07:30:49.675793+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.454434+0000","last_change":"2024-04-26T07:30:38.454554+0000","last_active":"2024-04-26T07:30:38.454434+0000","last_peered":"2024-04-26T07:30:38.454434+0000","last_clean":"2024-04-26T07:30:38.454434+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:30:38.454434+0000","last_undegraded":"2024-04-26T07:30:38.454434+0000","last_fullsized":"2024-04-26T07:30:38.454434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.454433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.698682+0000","last_change":"2024-04-26T07:30:42.698763+0000","last_active":"2024-04-26T07:30:42.698682+0000","last_peered":"2024-04-26T07:30:42.698682+0000","last_clean":"2024-04-26T07:30:42.698682+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:30:42.698682+0000","last_undegraded":"2024-04-26T07:30:42.698682+0000","last_fullsized":"2024-04-26T07:30:42.698682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.698682+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:33.855842+0000","last_change":"2024-04-26T07:31:33.855936+0000","last_active":"2024-04-26T07:31:33.855842+0000","last_peered":"2024-04-26T07:31:33.855842+0000","last_clean":"2024-04-26T07:31:33.855842+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:31:33.855842+0000","last_undegraded":"2024-04-26T07:31:33.855842+0000","last_fullsized":"2024-04-26T07:31:33.855842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:33.855841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:33.855841+0000","last_clean_scrub_stamp":"2024-04-26T07:31:33.855841+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:35.647109+0000","last_change":"2024-04-26T07:30:35.647193+0000","last_active":"2024-04-26T07:30:35.647109+0000","last_peered":"2024-04-26T07:30:35.647109+0000","last_clean":"2024-04-26T07:30:35.647109+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:30:35.647109+0000","last_undegraded":"2024-04-26T07:30:35.647109+0000","last_fullsized":"2024-04-26T07:30:35.647109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_clean_scrub_stamp":"2024-04-26T07:30:35.647108+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.207071+0000","last_change":"2024-04-26T07:30:25.207160+0000","last_active":"2024-04-26T07:30:25.207071+0000","last_peered":"2024-04-26T07:30:25.207071+0000","last_clean":"2024-04-26T07:30:25.207071+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:30:25.207071+0000","last_undegraded":"2024-04-26T07:30:25.207071+0000","last_fullsized":"2024-04-26T07:30:25.207071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.207070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.679673+0000","last_change":"2024-04-26T07:30:33.679748+0000","last_active":"2024-04-26T07:30:33.679673+0000","last_peered":"2024-04-26T07:30:33.679673+0000","last_clean":"2024-04-26T07:30:33.679673+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:30:33.679673+0000","last_undegraded":"2024-04-26T07:30:33.679673+0000","last_fullsized":"2024-04-26T07:30:33.679673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.679672+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:43.016723+0000","last_change":"2024-04-26T07:30:43.016816+0000","last_active":"2024-04-26T07:30:43.016723+0000","last_peered":"2024-04-26T07:30:43.016723+0000","last_clean":"2024-04-26T07:30:43.016723+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:30:43.016723+0000","last_undegraded":"2024-04-26T07:30:43.016723+0000","last_fullsized":"2024-04-26T07:30:43.016723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:43.016723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.867473+0000","last_change":"2024-04-26T07:30:09.867557+0000","last_active":"2024-04-26T07:30:09.867473+0000","last_peered":"2024-04-26T07:30:09.867473+0000","last_clean":"2024-04-26T07:30:09.867473+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:30:09.867473+0000","last_undegraded":"2024-04-26T07:30:09.867473+0000","last_fullsized":"2024-04-26T07:30:09.867473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.867473+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.023356+0000","last_change":"2024-04-26T07:30:11.023477+0000","last_active":"2024-04-26T07:30:11.023356+0000","last_peered":"2024-04-26T07:30:11.023356+0000","last_clean":"2024-04-26T07:30:11.023356+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:30:11.023356+0000","last_undegraded":"2024-04-26T07:30:11.023356+0000","last_fullsized":"2024-04-26T07:30:11.023356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.023356+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:30.811830+0000","last_change":"2024-04-26T07:30:30.811917+0000","last_active":"2024-04-26T07:30:30.811830+0000","last_peered":"2024-04-26T07:30:30.811830+0000","last_clean":"2024-04-26T07:30:30.811830+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:30:30.811830+0000","last_undegraded":"2024-04-26T07:30:30.811830+0000","last_fullsized":"2024-04-26T07:30:30.811830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_clean_scrub_stamp":"2024-04-26T07:30:30.811830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:14.491026+0000","last_change":"2024-04-26T07:30:14.491123+0000","last_active":"2024-04-26T07:30:14.491026+0000","last_peered":"2024-04-26T07:30:14.491026+0000","last_clean":"2024-04-26T07:30:14.491026+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:30:14.491026+0000","last_undegraded":"2024-04-26T07:30:14.491026+0000","last_fullsized":"2024-04-26T07:30:14.491026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_clean_scrub_stamp":"2024-04-26T07:30:14.491025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.413359+0000","last_change":"2024-04-26T07:30:09.413441+0000","last_active":"2024-04-26T07:30:09.413359+0000","last_peered":"2024-04-26T07:30:09.413359+0000","last_clean":"2024-04-26T07:30:09.413359+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:30:09.413359+0000","last_undegraded":"2024-04-26T07:30:09.413359+0000","last_fullsized":"2024-04-26T07:30:09.413359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.413358+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.849915+0000","last_change":"2024-04-26T07:30:31.850005+0000","last_active":"2024-04-26T07:30:31.849915+0000","last_peered":"2024-04-26T07:30:31.849915+0000","last_clean":"2024-04-26T07:30:31.849915+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:30:31.849915+0000","last_undegraded":"2024-04-26T07:30:31.849915+0000","last_fullsized":"2024-04-26T07:30:31.849915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.849914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.028509+0000","last_change":"2024-04-26T07:30:08.028621+0000","last_active":"2024-04-26T07:30:08.028509+0000","last_peered":"2024-04-26T07:30:08.028509+0000","last_clean":"2024-04-26T07:30:08.028509+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:30:08.028509+0000","last_undegraded":"2024-04-26T07:30:08.028509+0000","last_fullsized":"2024-04-26T07:30:08.028509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.028509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.809606+0000","last_change":"2024-04-26T07:30:12.809726+0000","last_active":"2024-04-26T07:30:12.809606+0000","last_peered":"2024-04-26T07:30:12.809606+0000","last_clean":"2024-04-26T07:30:12.809606+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:30:12.809606+0000","last_undegraded":"2024-04-26T07:30:12.809606+0000","last_fullsized":"2024-04-26T07:30:12.809606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.809605+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.923160+0000","last_change":"2024-04-26T07:30:33.923250+0000","last_active":"2024-04-26T07:30:33.923160+0000","last_peered":"2024-04-26T07:30:33.923160+0000","last_clean":"2024-04-26T07:30:33.923160+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:30:33.923160+0000","last_undegraded":"2024-04-26T07:30:33.923160+0000","last_fullsized":"2024-04-26T07:30:33.923160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.923160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.443421+0000","last_change":"2024-04-26T07:30:15.443501+0000","last_active":"2024-04-26T07:30:15.443421+0000","last_peered":"2024-04-26T07:30:15.443421+0000","last_clean":"2024-04-26T07:30:15.443421+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:30:15.443421+0000","last_undegraded":"2024-04-26T07:30:15.443421+0000","last_fullsized":"2024-04-26T07:30:15.443421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.443421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.891685+0000","last_change":"2024-04-26T07:30:08.891750+0000","last_active":"2024-04-26T07:30:08.891685+0000","last_peered":"2024-04-26T07:30:08.891685+0000","last_clean":"2024-04-26T07:30:08.891685+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:30:08.891685+0000","last_undegraded":"2024-04-26T07:30:08.891685+0000","last_fullsized":"2024-04-26T07:30:08.891685+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.891685+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.436730+0000","last_change":"2024-04-26T07:30:20.436817+0000","last_active":"2024-04-26T07:30:20.436730+0000","last_peered":"2024-04-26T07:30:20.436730+0000","last_clean":"2024-04-26T07:30:20.436730+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:30:20.436730+0000","last_undegraded":"2024-04-26T07:30:20.436730+0000","last_fullsized":"2024-04-26T07:30:20.436730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.436730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:29.840859+0000","last_change":"2024-04-26T07:31:29.840933+0000","last_active":"2024-04-26T07:31:29.840859+0000","last_peered":"2024-04-26T07:31:29.840859+0000","last_clean":"2024-04-26T07:31:29.840859+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:31:29.840859+0000","last_undegraded":"2024-04-26T07:31:29.840859+0000","last_fullsized":"2024-04-26T07:31:29.840859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:29.840858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:29.840858+0000","last_clean_scrub_stamp":"2024-04-26T07:31:29.840858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.493074+0000","last_change":"2024-04-26T07:30:12.493165+0000","last_active":"2024-04-26T07:30:12.493074+0000","last_peered":"2024-04-26T07:30:12.493074+0000","last_clean":"2024-04-26T07:30:12.493074+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:30:12.493074+0000","last_undegraded":"2024-04-26T07:30:12.493074+0000","last_fullsized":"2024-04-26T07:30:12.493074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.493074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.440210+0000","last_change":"2024-04-26T07:30:08.440323+0000","last_active":"2024-04-26T07:30:08.440210+0000","last_peered":"2024-04-26T07:30:08.440210+0000","last_clean":"2024-04-26T07:30:08.440210+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:30:08.440210+0000","last_undegraded":"2024-04-26T07:30:08.440210+0000","last_fullsized":"2024-04-26T07:30:08.440210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.440209+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.503368+0000","last_change":"2024-04-26T07:30:33.503463+0000","last_active":"2024-04-26T07:30:33.503368+0000","last_peered":"2024-04-26T07:30:33.503368+0000","last_clean":"2024-04-26T07:30:33.503368+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:30:33.503368+0000","last_undegraded":"2024-04-26T07:30:33.503368+0000","last_fullsized":"2024-04-26T07:30:33.503368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.503367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.416586+0000","last_change":"2024-04-26T07:30:16.416716+0000","last_active":"2024-04-26T07:30:16.416586+0000","last_peered":"2024-04-26T07:30:16.416586+0000","last_clean":"2024-04-26T07:30:16.416586+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:30:16.416586+0000","last_undegraded":"2024-04-26T07:30:16.416586+0000","last_fullsized":"2024-04-26T07:30:16.416586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.416585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.810615+0000","last_change":"2024-04-26T07:30:16.810700+0000","last_active":"2024-04-26T07:30:16.810615+0000","last_peered":"2024-04-26T07:30:16.810615+0000","last_clean":"2024-04-26T07:30:16.810615+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:30:16.810615+0000","last_undegraded":"2024-04-26T07:30:16.810615+0000","last_fullsized":"2024-04-26T07:30:16.810615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.810615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.538993+0000","last_change":"2024-04-26T07:30:32.539075+0000","last_active":"2024-04-26T07:30:32.538993+0000","last_peered":"2024-04-26T07:30:32.538993+0000","last_clean":"2024-04-26T07:30:32.538993+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:30:32.538993+0000","last_undegraded":"2024-04-26T07:30:32.538993+0000","last_fullsized":"2024-04-26T07:30:32.538993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.538992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:28.602216+0000","last_change":"2024-04-26T07:30:28.602296+0000","last_active":"2024-04-26T07:30:28.602216+0000","last_peered":"2024-04-26T07:30:28.602216+0000","last_clean":"2024-04-26T07:30:28.602216+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:30:28.602216+0000","last_undegraded":"2024-04-26T07:30:28.602216+0000","last_fullsized":"2024-04-26T07:30:28.602216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_clean_scrub_stamp":"2024-04-26T07:30:28.602216+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.818279+0000","last_change":"2024-04-26T07:30:11.818359+0000","last_active":"2024-04-26T07:30:11.818279+0000","last_peered":"2024-04-26T07:30:11.818279+0000","last_clean":"2024-04-26T07:30:11.818279+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:30:11.818279+0000","last_undegraded":"2024-04-26T07:30:11.818279+0000","last_fullsized":"2024-04-26T07:30:11.818279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.818278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:28.829091+0000","last_change":"2024-04-26T07:31:28.829177+0000","last_active":"2024-04-26T07:31:28.829091+0000","last_peered":"2024-04-26T07:31:28.829091+0000","last_clean":"2024-04-26T07:31:28.829091+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:31:28.829091+0000","last_undegraded":"2024-04-26T07:31:28.829091+0000","last_fullsized":"2024-04-26T07:31:28.829091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:28.829091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:28.829091+0000","last_clean_scrub_stamp":"2024-04-26T07:31:28.829091+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:17.377065+0000","last_change":"2024-04-26T07:30:17.377162+0000","last_active":"2024-04-26T07:30:17.377065+0000","last_peered":"2024-04-26T07:30:17.377065+0000","last_clean":"2024-04-26T07:30:17.377065+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:30:17.377065+0000","last_undegraded":"2024-04-26T07:30:17.377065+0000","last_fullsized":"2024-04-26T07:30:17.377065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_clean_scrub_stamp":"2024-04-26T07:30:17.377064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.414289+0000","last_change":"2024-04-26T07:30:11.414367+0000","last_active":"2024-04-26T07:30:11.414289+0000","last_peered":"2024-04-26T07:30:11.414289+0000","last_clean":"2024-04-26T07:30:11.414289+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:30:11.414289+0000","last_undegraded":"2024-04-26T07:30:11.414289+0000","last_fullsized":"2024-04-26T07:30:11.414289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.414288+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:19.136227+0000","last_change":"2024-04-26T07:30:19.136319+0000","last_active":"2024-04-26T07:30:19.136227+0000","last_peered":"2024-04-26T07:30:19.136227+0000","last_clean":"2024-04-26T07:30:19.136227+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:30:19.136227+0000","last_undegraded":"2024-04-26T07:30:19.136227+0000","last_fullsized":"2024-04-26T07:30:19.136227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:19.136226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'12","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:29.574126+0000","last_change":"2024-04-26T07:30:29.574207+0000","last_active":"2024-04-26T07:30:29.574126+0000","last_peered":"2024-04-26T07:30:29.574126+0000","last_clean":"2024-04-26T07:30:29.574126+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:30:29.574126+0000","last_undegraded":"2024-04-26T07:30:29.574126+0000","last_fullsized":"2024-04-26T07:30:29.574126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_clean_scrub_stamp":"2024-04-26T07:30:29.574125+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:39.295620+0000","last_change":"2024-04-26T07:30:39.295711+0000","last_active":"2024-04-26T07:30:39.295620+0000","last_peered":"2024-04-26T07:30:39.295620+0000","last_clean":"2024-04-26T07:30:39.295620+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:30:39.295620+0000","last_undegraded":"2024-04-26T07:30:39.295620+0000","last_fullsized":"2024-04-26T07:30:39.295620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_clean_scrub_stamp":"2024-04-26T07:30:39.295619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.788374+0000","last_change":"2024-04-26T07:30:27.788453+0000","last_active":"2024-04-26T07:30:27.788374+0000","last_peered":"2024-04-26T07:30:27.788374+0000","last_clean":"2024-04-26T07:30:27.788374+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:30:27.788374+0000","last_undegraded":"2024-04-26T07:30:27.788374+0000","last_fullsized":"2024-04-26T07:30:27.788374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.788374+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:36.226727+0000","last_change":"2024-04-26T07:30:36.226816+0000","last_active":"2024-04-26T07:30:36.226727+0000","last_peered":"2024-04-26T07:30:36.226727+0000","last_clean":"2024-04-26T07:30:36.226727+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:30:36.226727+0000","last_undegraded":"2024-04-26T07:30:36.226727+0000","last_fullsized":"2024-04-26T07:30:36.226727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_clean_scrub_stamp":"2024-04-26T07:30:36.226726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:11.969596+0000","last_change":"2024-04-26T07:31:11.969715+0000","last_active":"2024-04-26T07:31:11.969596+0000","last_peered":"2024-04-26T07:31:11.969596+0000","last_clean":"2024-04-26T07:31:11.969596+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:31:11.969596+0000","last_undegraded":"2024-04-26T07:31:11.969596+0000","last_fullsized":"2024-04-26T07:31:11.969596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:31:11.969596+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:31:11.969596+0000","last_clean_scrub_stamp":"2024-04-26T07:31:11.969596+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.249230+0000","last_change":"2024-04-26T07:30:32.249320+0000","last_active":"2024-04-26T07:30:32.249230+0000","last_peered":"2024-04-26T07:30:32.249230+0000","last_clean":"2024-04-26T07:30:32.249230+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:30:32.249230+0000","last_undegraded":"2024-04-26T07:30:32.249230+0000","last_fullsized":"2024-04-26T07:30:32.249230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.249230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:18.959835+0000","last_change":"2024-04-26T07:31:18.959927+0000","last_active":"2024-04-26T07:31:18.959835+0000","last_peered":"2024-04-26T07:31:18.959835+0000","last_clean":"2024-04-26T07:31:18.959835+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:31:18.959835+0000","last_undegraded":"2024-04-26T07:31:18.959835+0000","last_fullsized":"2024-04-26T07:31:18.959835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:31:18.959834+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:31:18.959834+0000","last_clean_scrub_stamp":"2024-04-26T07:31:18.959834+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138474+0000","last_change":"2024-04-26T07:28:31.155979+0000","last_active":"2024-04-26T07:28:32.138474+0000","last_peered":"2024-04-26T07:28:32.138474+0000","last_clean":"2024-04-26T07:28:32.138474+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:28:32.138474+0000","last_undegraded":"2024-04-26T07:28:32.138474+0000","last_fullsized":"2024-04-26T07:28:32.138474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.561764+0000","last_change":"2024-04-26T07:30:31.561845+0000","last_active":"2024-04-26T07:30:31.561764+0000","last_peered":"2024-04-26T07:30:31.561764+0000","last_clean":"2024-04-26T07:30:31.561764+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:30:31.561764+0000","last_undegraded":"2024-04-26T07:30:31.561764+0000","last_fullsized":"2024-04-26T07:30:31.561764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.561764+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.216511+0000","last_change":"2024-04-26T07:30:31.216609+0000","last_active":"2024-04-26T07:30:31.216511+0000","last_peered":"2024-04-26T07:30:31.216511+0000","last_clean":"2024-04-26T07:30:31.216511+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:30:31.216511+0000","last_undegraded":"2024-04-26T07:30:31.216511+0000","last_fullsized":"2024-04-26T07:30:31.216511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.216510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.967952+0000","last_change":"2024-04-26T07:30:44.968081+0000","last_active":"2024-04-26T07:30:44.967952+0000","last_peered":"2024-04-26T07:30:44.967952+0000","last_clean":"2024-04-26T07:30:44.967952+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:30:44.967952+0000","last_undegraded":"2024-04-26T07:30:44.967952+0000","last_fullsized":"2024-04-26T07:30:44.967952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.967951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.138033+0000","last_change":"2024-04-26T07:28:31.155426+0000","last_active":"2024-04-26T07:28:32.138033+0000","last_peered":"2024-04-26T07:28:32.138033+0000","last_clean":"2024-04-26T07:28:32.138033+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:28:32.138033+0000","last_undegraded":"2024-04-26T07:28:32.138033+0000","last_fullsized":"2024-04-26T07:28:32.138033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.450558+0000","last_change":"2024-04-26T07:30:50.450657+0000","last_active":"2024-04-26T07:30:50.450558+0000","last_peered":"2024-04-26T07:30:50.450558+0000","last_clean":"2024-04-26T07:30:50.450558+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:30:50.450558+0000","last_undegraded":"2024-04-26T07:30:50.450558+0000","last_fullsized":"2024-04-26T07:30:50.450558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.450557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137794+0000","last_change":"2024-04-26T07:28:31.155687+0000","last_active":"2024-04-26T07:28:32.137794+0000","last_peered":"2024-04-26T07:28:32.137794+0000","last_clean":"2024-04-26T07:28:32.137794+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:28:32.137794+0000","last_undegraded":"2024-04-26T07:28:32.137794+0000","last_fullsized":"2024-04-26T07:28:32.137794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:46.936609+0000","last_change":"2024-04-26T07:30:46.936704+0000","last_active":"2024-04-26T07:30:46.936609+0000","last_peered":"2024-04-26T07:30:46.936609+0000","last_clean":"2024-04-26T07:30:46.936609+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:30:46.936609+0000","last_undegraded":"2024-04-26T07:30:46.936609+0000","last_fullsized":"2024-04-26T07:30:46.936609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_clean_scrub_stamp":"2024-04-26T07:30:46.936608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.27900000000000003,"15min":0.27000000000000002},"min":{"1min":0.21199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.308,"5min":0.30299999999999999,"15min":0.29899999999999999},"min":{"1min":0.215,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.313,"15min":0.308},"min":{"1min":0.21199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.31,"15min":0.30599999999999999},"min":{"1min":0.23799999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.317,"15min":0.313},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.33800000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.28999999999999998,"15min":0.28699999999999998},"min":{"1min":0.222,"5min":0.16,"15min":0.16},"max":{"1min":0.41999999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.308},"min":{"1min":0.22800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.432,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.498,"5min":0.503,"15min":0.503},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.433}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.28799999999999998,"15min":0.27300000000000002},"min":{"1min":0.26900000000000002,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.45000000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.29199999999999998},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.47299999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.32500000000000001,"15min":0.315},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.32500000000000001,"15min":0.313},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.318},"min":{"1min":0.29799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.26400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.45000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.379}]}]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.29999999999999999},"min":{"1min":0.23599999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.439,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.32100000000000001},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48299999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.222}]},{"osd":2,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.33700000000000002},"min":{"1min":0.249,"5min":0.193,"15min":0.193},"max":{"1min":0.47999999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.315},{"interface":"front","average":{"1min":0.38,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.46400000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.49199999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.27200000000000002}]}]}]}} 2024-04-26T07:31:50.023 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.023 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.024 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.024 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.024 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.024 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.025 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.026 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.026 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.026 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:31:50.026 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:32:10.027 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:32:10.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.147+0000 7f3cda56b700 1 Processor -- start 2024-04-26T07:32:10.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.147+0000 7f3cda56b700 1 -- start start 2024-04-26T07:32:10.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cda56b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406c7d0 0x7f3cd41360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:10.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cda56b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cd405c080 0x7f3cd4141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:10.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cda56b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd40970a0 con 0x7f3cd4096320 2024-04-26T07:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cda56b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd4133c10 con 0x7f3cd405c080 2024-04-26T07:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cda56b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd4136780 con 0x7f3cd406c7d0 2024-04-26T07:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cd3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406c7d0 0x7f3cd41360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cd3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406c7d0 0x7f3cd41360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:47070/0 (socket says 172.21.15.31:47070) 2024-04-26T07:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cd3fff700 1 -- 172.21.15.31:0/2680681186 learned_addr learned my addr 172.21.15.31:0/2680681186 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.148+0000 7f3cd8b08700 1 --2- 172.21.15.31:0/2680681186 >> v2:172.21.15.31:3300/0 conn(0x7f3cd405c080 0x7f3cd4141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd3fff700 1 -- 172.21.15.31:0/2680681186 >> v2:172.21.15.31:3300/0 conn(0x7f3cd405c080 msgr2=0x7f3cd4141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd3fff700 1 --2- 172.21.15.31:0/2680681186 >> v2:172.21.15.31:3300/0 conn(0x7f3cd405c080 0x7f3cd4141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd3fff700 1 -- 172.21.15.31:0/2680681186 >> v1:172.21.15.31:6789/0 conn(0x7f3cd4096320 legacy=0x7f3cd405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd3fff700 1 -- 172.21.15.31:0/2680681186 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4136a40 con 0x7f3cd406c7d0 2024-04-26T07:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd8b08700 1 --2- 172.21.15.31:0/2680681186 >> v2:172.21.15.31:3300/0 conn(0x7f3cd405c080 0x7f3cd4141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd3fff700 1 --2- 172.21.15.31:0/2680681186 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406c7d0 0x7f3cd41360f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3cc4002f70 tx=0x7f3cc4006eb0).ready entity=mon.2 client_cookie=8d5b77f6aad9412 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd2ffd700 1 -- 172.21.15.31:0/2680681186 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cc400d570 con 0x7f3cd406c7d0 2024-04-26T07:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd2ffd700 1 -- 172.21.15.31:0/2680681186 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4000e90 con 0x7f3cd406c7d0 2024-04-26T07:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cd2ffd700 1 -- 172.21.15.31:0/2680681186 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cc400d900 con 0x7f3cd406c7d0 2024-04-26T07:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cda56b700 1 -- 172.21.15.31:0/2680681186 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406c7d0 msgr2=0x7f3cd41360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cda56b700 1 --2- 172.21.15.31:0/2680681186 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406c7d0 0x7f3cd41360f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3cc4002f70 tx=0x7f3cc4006eb0).stop 2024-04-26T07:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cda56b700 1 -- 172.21.15.31:0/2680681186 shutdown_connections 2024-04-26T07:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cda56b700 1 --2- 172.21.15.31:0/2680681186 >> v2:172.21.15.31:3300/0 conn(0x7f3cd405c080 0x7f3cd4141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cda56b700 1 --2- 172.21.15.31:0/2680681186 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406c7d0 0x7f3cd41360f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.149+0000 7f3cda56b700 1 -- 172.21.15.31:0/2680681186 >> 172.21.15.31:0/2680681186 conn(0x7f3cd4061370 msgr2=0x7f3cd406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.150+0000 7f3cda56b700 1 -- 172.21.15.31:0/2680681186 shutdown_connections 2024-04-26T07:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.150+0000 7f3cda56b700 1 -- 172.21.15.31:0/2680681186 wait complete. 2024-04-26T07:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.150+0000 7f3cda56b700 1 Processor -- start 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.150+0000 7f3cda56b700 1 -- start start 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cda56b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd405c080 0x7f3cd409db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cda56b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406c7d0 0x7f3cd4067b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cda56b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd4096320 0x7f3cd41498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cda56b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd409d3e0 con 0x7f3cd4096320 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cda56b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd41493b0 con 0x7f3cd406c7d0 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cda56b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd4149630 con 0x7f3cd405c080 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cd3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd405c080 0x7f3cd409db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cd8b08700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd4096320 0x7f3cd41498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cd3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd405c080 0x7f3cd409db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:47086/0 (socket says 172.21.15.31:47086) 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cd8b08700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd4096320 0x7f3cd41498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44884/0 (socket says 172.21.15.31:44884) 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cd3fff700 1 -- 172.21.15.31:0/391765290 learned_addr learned my addr 172.21.15.31:0/391765290 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.151+0000 7f3cd37fe700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406c7d0 0x7f3cd4067b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd3fff700 1 -- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406c7d0 msgr2=0x7f3cd4067b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd3fff700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406c7d0 0x7f3cd4067b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd3fff700 1 -- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd4096320 msgr2=0x7f3cd41498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd3fff700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd4096320 0x7f3cd41498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd3fff700 1 -- 172.21.15.31:0/391765290 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc009470 con 0x7f3cd405c080 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd8b08700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd4096320 0x7f3cd41498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd3fff700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd405c080 0x7f3cd409db50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3cd4066ad0 tx=0x7f3cc4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd17fa700 1 -- 172.21.15.31:0/391765290 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cc4011860 con 0x7f3cd405c080 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd17fa700 1 -- 172.21.15.31:0/391765290 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40119c0 con 0x7f3cd405c080 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc400b1e0 con 0x7f3cd405c080 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cd17fa700 1 -- 172.21.15.31:0/391765290 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cc4011d20 con 0x7f3cd405c080 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.152+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd4068070 con 0x7f3cd405c080 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.153+0000 7f3cd17fa700 1 -- 172.21.15.31:0/391765290 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3cc4025030 con 0x7f3cd405c080 2024-04-26T07:32:10.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.153+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd40679d0 con 0x7f3cd405c080 2024-04-26T07:32:10.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.153+0000 7f3cd17fa700 1 -- 172.21.15.31:0/391765290 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3cc404bb70 con 0x7f3cd405c080 2024-04-26T07:32:10.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.156+0000 7f3cd17fa700 1 -- 172.21.15.31:0/391765290 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3cc401eb50 con 0x7f3cd405c080 2024-04-26T07:32:10.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.270+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cd40975a0 con 0x7f3cb4038da0 2024-04-26T07:32:10.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.277+0000 7f3cd17fa700 1 -- 172.21.15.31:0/391765290 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252256 (unknown 2965378022 0 1819759347) 0x7f3cd40975a0 con 0x7f3cb4038da0 2024-04-26T07:32:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:32:10.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 >> v1:172.21.15.31:6816/39613 conn(0x7f3cb4038da0 legacy=0x7f3cb403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:10.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd405c080 msgr2=0x7f3cd409db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:10.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd405c080 0x7f3cd409db50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3cd4066ad0 tx=0x7f3cc4015000).stop 2024-04-26T07:32:10.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 shutdown_connections 2024-04-26T07:32:10.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd405c080 0x7f3cd409db50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:10.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd4096320 0x7f3cd41498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:10.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 --2- 172.21.15.31:0/391765290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406c7d0 0x7f3cd4067b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:10.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 >> 172.21.15.31:0/391765290 conn(0x7f3cd4061370 msgr2=0x7f3cd40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:10.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 shutdown_connections 2024-04-26T07:32:10.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:10.279+0000 7f3cda56b700 1 -- 172.21.15.31:0/391765290 wait complete. 2024-04-26T07:32:10.284 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:32:10.290 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-04-26T07:32:10.025306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13536,"num_omap_keys":21,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002939"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.426802+0000","last_change":"2024-04-26T07:30:52.426911+0000","last_active":"2024-04-26T07:30:52.426802+0000","last_peered":"2024-04-26T07:30:52.426802+0000","last_clean":"2024-04-26T07:30:52.426802+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:30:52.426802+0000","last_undegraded":"2024-04-26T07:30:52.426802+0000","last_fullsized":"2024-04-26T07:30:52.426802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.426801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.387022+0000","last_change":"2024-04-26T07:30:51.387112+0000","last_active":"2024-04-26T07:30:51.387022+0000","last_peered":"2024-04-26T07:30:51.387022+0000","last_clean":"2024-04-26T07:30:51.387022+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:30:51.387022+0000","last_undegraded":"2024-04-26T07:30:51.387022+0000","last_fullsized":"2024-04-26T07:30:51.387022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.387021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:17.334912+0000","last_change":"2024-04-26T07:31:17.335002+0000","last_active":"2024-04-26T07:31:17.334912+0000","last_peered":"2024-04-26T07:31:17.334912+0000","last_clean":"2024-04-26T07:31:17.334912+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:31:17.334912+0000","last_undegraded":"2024-04-26T07:31:17.334912+0000","last_fullsized":"2024-04-26T07:31:17.334912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:17.334911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:17.334911+0000","last_clean_scrub_stamp":"2024-04-26T07:31:17.334911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:16.290874+0000","last_change":"2024-04-26T07:31:16.290972+0000","last_active":"2024-04-26T07:31:16.290874+0000","last_peered":"2024-04-26T07:31:16.290874+0000","last_clean":"2024-04-26T07:31:16.290874+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:31:16.290874+0000","last_undegraded":"2024-04-26T07:31:16.290874+0000","last_fullsized":"2024-04-26T07:31:16.290874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:16.290873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:16.290873+0000","last_clean_scrub_stamp":"2024-04-26T07:31:16.290873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:13.357195+0000","last_change":"2024-04-26T07:31:13.357281+0000","last_active":"2024-04-26T07:31:13.357195+0000","last_peered":"2024-04-26T07:31:13.357195+0000","last_clean":"2024-04-26T07:31:13.357195+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:31:13.357195+0000","last_undegraded":"2024-04-26T07:31:13.357195+0000","last_fullsized":"2024-04-26T07:31:13.357195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:13.357195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:13.357195+0000","last_clean_scrub_stamp":"2024-04-26T07:31:13.357195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.139383+0000","last_change":"2024-04-26T07:28:31.161135+0000","last_active":"2024-04-26T07:28:32.139383+0000","last_peered":"2024-04-26T07:28:32.139383+0000","last_clean":"2024-04-26T07:28:32.139383+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:28:32.139383+0000","last_undegraded":"2024-04-26T07:28:32.139383+0000","last_fullsized":"2024-04-26T07:28:32.139383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137916+0000","last_change":"2024-04-26T07:28:31.174569+0000","last_active":"2024-04-26T07:28:32.137916+0000","last_peered":"2024-04-26T07:28:32.137916+0000","last_clean":"2024-04-26T07:28:32.137916+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:28:32.137916+0000","last_undegraded":"2024-04-26T07:28:32.137916+0000","last_fullsized":"2024-04-26T07:28:32.137916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:12.068148+0000","last_change":"2024-04-26T07:31:12.068229+0000","last_active":"2024-04-26T07:31:12.068148+0000","last_peered":"2024-04-26T07:31:12.068148+0000","last_clean":"2024-04-26T07:31:12.068148+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:31:12.068148+0000","last_undegraded":"2024-04-26T07:31:12.068148+0000","last_fullsized":"2024-04-26T07:31:12.068148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:12.068147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:12.068147+0000","last_clean_scrub_stamp":"2024-04-26T07:31:12.068147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:12.351167+0000","last_change":"2024-04-26T07:31:12.351287+0000","last_active":"2024-04-26T07:31:12.351167+0000","last_peered":"2024-04-26T07:31:12.351167+0000","last_clean":"2024-04-26T07:31:12.351167+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:31:12.351167+0000","last_undegraded":"2024-04-26T07:31:12.351167+0000","last_fullsized":"2024-04-26T07:31:12.351167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:12.351167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:12.351167+0000","last_clean_scrub_stamp":"2024-04-26T07:31:12.351167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.047204+0000","last_change":"2024-04-26T07:31:06.047291+0000","last_active":"2024-04-26T07:31:06.047204+0000","last_peered":"2024-04-26T07:31:06.047204+0000","last_clean":"2024-04-26T07:31:06.047204+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:31:06.047204+0000","last_undegraded":"2024-04-26T07:31:06.047204+0000","last_fullsized":"2024-04-26T07:31:06.047204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.047203+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:04.079986+0000","last_change":"2024-04-26T07:31:04.080077+0000","last_active":"2024-04-26T07:31:04.079986+0000","last_peered":"2024-04-26T07:31:04.079986+0000","last_clean":"2024-04-26T07:31:04.079986+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:31:04.079986+0000","last_undegraded":"2024-04-26T07:31:04.079986+0000","last_fullsized":"2024-04-26T07:31:04.079986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_clean_scrub_stamp":"2024-04-26T07:31:04.079985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:47.333000+0000","last_change":"2024-04-26T07:30:47.333131+0000","last_active":"2024-04-26T07:30:47.333000+0000","last_peered":"2024-04-26T07:30:47.333000+0000","last_clean":"2024-04-26T07:30:47.333000+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:30:47.333000+0000","last_undegraded":"2024-04-26T07:30:47.333000+0000","last_fullsized":"2024-04-26T07:30:47.333000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_clean_scrub_stamp":"2024-04-26T07:30:47.333000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.307226+0000","last_change":"2024-04-26T07:30:42.307331+0000","last_active":"2024-04-26T07:30:42.307226+0000","last_peered":"2024-04-26T07:30:42.307226+0000","last_clean":"2024-04-26T07:30:42.307226+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:30:42.307226+0000","last_undegraded":"2024-04-26T07:30:42.307226+0000","last_fullsized":"2024-04-26T07:30:42.307226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.307226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:00.092689+0000","last_change":"2024-04-26T07:31:00.092776+0000","last_active":"2024-04-26T07:31:00.092689+0000","last_peered":"2024-04-26T07:31:00.092689+0000","last_clean":"2024-04-26T07:31:00.092689+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:31:00.092689+0000","last_undegraded":"2024-04-26T07:31:00.092689+0000","last_fullsized":"2024-04-26T07:31:00.092689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_clean_scrub_stamp":"2024-04-26T07:31:00.092689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:10.341169+0000","last_change":"2024-04-26T07:31:10.341266+0000","last_active":"2024-04-26T07:31:10.341169+0000","last_peered":"2024-04-26T07:31:10.341169+0000","last_clean":"2024-04-26T07:31:10.341169+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:31:10.341169+0000","last_undegraded":"2024-04-26T07:31:10.341169+0000","last_fullsized":"2024-04-26T07:31:10.341169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:10.341168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:10.341168+0000","last_clean_scrub_stamp":"2024-04-26T07:31:10.341168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T07:28:32.137194+0000","last_change":"2024-04-26T07:28:31.174513+0000","last_active":"2024-04-26T07:28:32.137194+0000","last_peered":"2024-04-26T07:28:32.137194+0000","last_clean":"2024-04-26T07:28:32.137194+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:28:32.137194+0000","last_undegraded":"2024-04-26T07:28:32.137194+0000","last_fullsized":"2024-04-26T07:28:32.137194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:28:30.812831+0000","last_clean_scrub_stamp":"2024-04-26T07:28:30.812831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.307189+0000","last_change":"2024-04-26T07:31:06.307276+0000","last_active":"2024-04-26T07:31:06.307189+0000","last_peered":"2024-04-26T07:31:06.307189+0000","last_clean":"2024-04-26T07:31:06.307189+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:31:06.307189+0000","last_undegraded":"2024-04-26T07:31:06.307189+0000","last_fullsized":"2024-04-26T07:31:06.307189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.307188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:59.385202+0000","last_change":"2024-04-26T07:30:59.385291+0000","last_active":"2024-04-26T07:30:59.385202+0000","last_peered":"2024-04-26T07:30:59.385202+0000","last_clean":"2024-04-26T07:30:59.385202+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:30:59.385202+0000","last_undegraded":"2024-04-26T07:30:59.385202+0000","last_fullsized":"2024-04-26T07:30:59.385202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_clean_scrub_stamp":"2024-04-26T07:30:59.385201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:40.294718+0000","last_change":"2024-04-26T07:30:40.294811+0000","last_active":"2024-04-26T07:30:40.294718+0000","last_peered":"2024-04-26T07:30:40.294718+0000","last_clean":"2024-04-26T07:30:40.294718+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:30:40.294718+0000","last_undegraded":"2024-04-26T07:30:40.294718+0000","last_fullsized":"2024-04-26T07:30:40.294718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_clean_scrub_stamp":"2024-04-26T07:30:40.294717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.022023+0000","last_change":"2024-04-26T07:30:56.022116+0000","last_active":"2024-04-26T07:30:56.022023+0000","last_peered":"2024-04-26T07:30:56.022023+0000","last_clean":"2024-04-26T07:30:56.022023+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:30:56.022023+0000","last_undegraded":"2024-04-26T07:30:56.022023+0000","last_fullsized":"2024-04-26T07:30:56.022023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.022022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:55.027604+0000","last_change":"2024-04-26T07:30:55.027705+0000","last_active":"2024-04-26T07:30:55.027604+0000","last_peered":"2024-04-26T07:30:55.027604+0000","last_clean":"2024-04-26T07:30:55.027604+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:30:55.027604+0000","last_undegraded":"2024-04-26T07:30:55.027604+0000","last_fullsized":"2024-04-26T07:30:55.027604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_clean_scrub_stamp":"2024-04-26T07:30:55.027603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.447536+0000","last_change":"2024-04-26T07:30:52.447634+0000","last_active":"2024-04-26T07:30:52.447536+0000","last_peered":"2024-04-26T07:30:52.447536+0000","last_clean":"2024-04-26T07:30:52.447536+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:30:52.447536+0000","last_undegraded":"2024-04-26T07:30:52.447536+0000","last_fullsized":"2024-04-26T07:30:52.447536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.447536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:04.922994+0000","last_change":"2024-04-26T07:32:04.923102+0000","last_active":"2024-04-26T07:32:04.922994+0000","last_peered":"2024-04-26T07:32:04.922994+0000","last_clean":"2024-04-26T07:32:04.922994+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:32:04.922994+0000","last_undegraded":"2024-04-26T07:32:04.922994+0000","last_fullsized":"2024-04-26T07:32:04.922994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:04.922994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:04.922994+0000","last_clean_scrub_stamp":"2024-04-26T07:32:04.922994+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:54.059185+0000","last_change":"2024-04-26T07:30:54.059310+0000","last_active":"2024-04-26T07:30:54.059185+0000","last_peered":"2024-04-26T07:30:54.059185+0000","last_clean":"2024-04-26T07:30:54.059185+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:30:54.059185+0000","last_undegraded":"2024-04-26T07:30:54.059185+0000","last_fullsized":"2024-04-26T07:30:54.059185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_clean_scrub_stamp":"2024-04-26T07:30:54.059185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:53.020287+0000","last_change":"2024-04-26T07:30:53.020393+0000","last_active":"2024-04-26T07:30:53.020287+0000","last_peered":"2024-04-26T07:30:53.020287+0000","last_clean":"2024-04-26T07:30:53.020287+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:30:53.020287+0000","last_undegraded":"2024-04-26T07:30:53.020287+0000","last_fullsized":"2024-04-26T07:30:53.020287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_clean_scrub_stamp":"2024-04-26T07:30:53.020286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.976317+0000","last_change":"2024-04-26T07:30:50.976414+0000","last_active":"2024-04-26T07:30:50.976317+0000","last_peered":"2024-04-26T07:30:50.976317+0000","last_clean":"2024-04-26T07:30:50.976317+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:30:50.976317+0000","last_undegraded":"2024-04-26T07:30:50.976317+0000","last_fullsized":"2024-04-26T07:30:50.976317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.976316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:03.926941+0000","last_change":"2024-04-26T07:32:03.927039+0000","last_active":"2024-04-26T07:32:03.926941+0000","last_peered":"2024-04-26T07:32:03.926941+0000","last_clean":"2024-04-26T07:32:03.926941+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:32:03.926941+0000","last_undegraded":"2024-04-26T07:32:03.926941+0000","last_fullsized":"2024-04-26T07:32:03.926941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:03.926941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:03.926941+0000","last_clean_scrub_stamp":"2024-04-26T07:32:03.926941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.890710+0000","last_change":"2024-04-26T07:30:23.890791+0000","last_active":"2024-04-26T07:30:23.890710+0000","last_peered":"2024-04-26T07:30:23.890710+0000","last_clean":"2024-04-26T07:30:23.890710+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:30:23.890710+0000","last_undegraded":"2024-04-26T07:30:23.890710+0000","last_fullsized":"2024-04-26T07:30:23.890710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.890710+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:49.881843+0000","last_change":"2024-04-26T07:31:49.881917+0000","last_active":"2024-04-26T07:31:49.881843+0000","last_peered":"2024-04-26T07:31:49.881843+0000","last_clean":"2024-04-26T07:31:49.881843+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:31:49.881843+0000","last_undegraded":"2024-04-26T07:31:49.881843+0000","last_fullsized":"2024-04-26T07:31:49.881843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:49.881842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:49.881842+0000","last_clean_scrub_stamp":"2024-04-26T07:31:49.881842+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:22.844919+0000","last_change":"2024-04-26T07:30:22.845011+0000","last_active":"2024-04-26T07:30:22.844919+0000","last_peered":"2024-04-26T07:30:22.844919+0000","last_clean":"2024-04-26T07:30:22.844919+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:30:22.844919+0000","last_undegraded":"2024-04-26T07:30:22.844919+0000","last_fullsized":"2024-04-26T07:30:22.844919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_clean_scrub_stamp":"2024-04-26T07:30:22.844919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.440808+0000","last_change":"2024-04-26T07:30:44.440891+0000","last_active":"2024-04-26T07:30:44.440808+0000","last_peered":"2024-04-26T07:30:44.440808+0000","last_clean":"2024-04-26T07:30:44.440808+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:30:44.440808+0000","last_undegraded":"2024-04-26T07:30:44.440808+0000","last_fullsized":"2024-04-26T07:30:44.440808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.440807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:08.046243+0000","last_change":"2024-04-26T07:31:08.046335+0000","last_active":"2024-04-26T07:31:08.046243+0000","last_peered":"2024-04-26T07:31:08.046243+0000","last_clean":"2024-04-26T07:31:08.046243+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:31:08.046243+0000","last_undegraded":"2024-04-26T07:31:08.046243+0000","last_fullsized":"2024-04-26T07:31:08.046243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:31:08.046243+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:31:08.046243+0000","last_clean_scrub_stamp":"2024-04-26T07:31:08.046243+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:53.901553+0000","last_change":"2024-04-26T07:31:53.901658+0000","last_active":"2024-04-26T07:31:53.901553+0000","last_peered":"2024-04-26T07:31:53.901553+0000","last_clean":"2024-04-26T07:31:53.901553+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:31:53.901553+0000","last_undegraded":"2024-04-26T07:31:53.901553+0000","last_fullsized":"2024-04-26T07:31:53.901553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:53.901552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:53.901552+0000","last_clean_scrub_stamp":"2024-04-26T07:31:53.901552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'9","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.580238+0000","last_change":"2024-04-26T07:30:25.580325+0000","last_active":"2024-04-26T07:30:25.580238+0000","last_peered":"2024-04-26T07:30:25.580238+0000","last_clean":"2024-04-26T07:30:25.580238+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:30:25.580238+0000","last_undegraded":"2024-04-26T07:30:25.580238+0000","last_fullsized":"2024-04-26T07:30:25.580238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'9","last_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_deep_scrub":"19'9","last_deep_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.580237+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:37.906762+0000","last_change":"2024-04-26T07:31:37.906853+0000","last_active":"2024-04-26T07:31:37.906762+0000","last_peered":"2024-04-26T07:31:37.906762+0000","last_clean":"2024-04-26T07:31:37.906762+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:31:37.906762+0000","last_undegraded":"2024-04-26T07:31:37.906762+0000","last_fullsized":"2024-04-26T07:31:37.906762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:37.906761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:37.906761+0000","last_clean_scrub_stamp":"2024-04-26T07:31:37.906761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.163184+0000","last_change":"2024-04-26T07:30:15.163266+0000","last_active":"2024-04-26T07:30:15.163184+0000","last_peered":"2024-04-26T07:30:15.163184+0000","last_clean":"2024-04-26T07:30:15.163184+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:30:15.163184+0000","last_undegraded":"2024-04-26T07:30:15.163184+0000","last_fullsized":"2024-04-26T07:30:15.163184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.163183+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:38.869746+0000","last_change":"2024-04-26T07:31:38.869839+0000","last_active":"2024-04-26T07:31:38.869746+0000","last_peered":"2024-04-26T07:31:38.869746+0000","last_clean":"2024-04-26T07:31:38.869746+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:31:38.869746+0000","last_undegraded":"2024-04-26T07:31:38.869746+0000","last_fullsized":"2024-04-26T07:31:38.869746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:38.869746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:38.869746+0000","last_clean_scrub_stamp":"2024-04-26T07:31:38.869746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.570415+0000","last_change":"2024-04-26T07:30:23.570499+0000","last_active":"2024-04-26T07:30:23.570415+0000","last_peered":"2024-04-26T07:30:23.570415+0000","last_clean":"2024-04-26T07:30:23.570415+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:30:23.570415+0000","last_undegraded":"2024-04-26T07:30:23.570415+0000","last_fullsized":"2024-04-26T07:30:23.570415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.570415+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.011724+0000","last_change":"2024-04-26T07:30:44.011821+0000","last_active":"2024-04-26T07:30:44.011724+0000","last_peered":"2024-04-26T07:30:44.011724+0000","last_clean":"2024-04-26T07:30:44.011724+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:30:44.011724+0000","last_undegraded":"2024-04-26T07:30:44.011724+0000","last_fullsized":"2024-04-26T07:30:44.011724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.011723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'21","reported_seq":35,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:07.012832+0000","last_change":"2024-04-26T07:31:07.012911+0000","last_active":"2024-04-26T07:31:07.012832+0000","last_peered":"2024-04-26T07:31:07.012832+0000","last_clean":"2024-04-26T07:31:07.012832+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:31:07.012832+0000","last_undegraded":"2024-04-26T07:31:07.012832+0000","last_fullsized":"2024-04-26T07:31:07.012832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'21","last_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_deep_scrub":"19'21","last_deep_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_clean_scrub_stamp":"2024-04-26T07:31:07.012831+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.232011+0000","last_change":"2024-04-26T07:30:27.232105+0000","last_active":"2024-04-26T07:30:27.232011+0000","last_peered":"2024-04-26T07:30:27.232011+0000","last_clean":"2024-04-26T07:30:27.232011+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:30:27.232011+0000","last_undegraded":"2024-04-26T07:30:27.232011+0000","last_fullsized":"2024-04-26T07:30:27.232011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.232010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:01.928484+0000","last_change":"2024-04-26T07:31:01.928571+0000","last_active":"2024-04-26T07:31:01.928484+0000","last_peered":"2024-04-26T07:31:01.928484+0000","last_clean":"2024-04-26T07:31:01.928484+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:31:01.928484+0000","last_undegraded":"2024-04-26T07:31:01.928484+0000","last_fullsized":"2024-04-26T07:31:01.928484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_clean_scrub_stamp":"2024-04-26T07:31:01.928484+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:43.892447+0000","last_change":"2024-04-26T07:31:43.892541+0000","last_active":"2024-04-26T07:31:43.892447+0000","last_peered":"2024-04-26T07:31:43.892447+0000","last_clean":"2024-04-26T07:31:43.892447+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:31:43.892447+0000","last_undegraded":"2024-04-26T07:31:43.892447+0000","last_fullsized":"2024-04-26T07:31:43.892447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:43.892447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:43.892447+0000","last_clean_scrub_stamp":"2024-04-26T07:31:43.892447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:21.505390+0000","last_change":"2024-04-26T07:30:21.505470+0000","last_active":"2024-04-26T07:30:21.505390+0000","last_peered":"2024-04-26T07:30:21.505390+0000","last_clean":"2024-04-26T07:30:21.505390+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:30:21.505390+0000","last_undegraded":"2024-04-26T07:30:21.505390+0000","last_fullsized":"2024-04-26T07:30:21.505390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_clean_scrub_stamp":"2024-04-26T07:30:21.505390+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:45.872604+0000","last_change":"2024-04-26T07:31:45.872739+0000","last_active":"2024-04-26T07:31:45.872604+0000","last_peered":"2024-04-26T07:31:45.872604+0000","last_clean":"2024-04-26T07:31:45.872604+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:31:45.872604+0000","last_undegraded":"2024-04-26T07:31:45.872604+0000","last_fullsized":"2024-04-26T07:31:45.872604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:45.872603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:45.872603+0000","last_clean_scrub_stamp":"2024-04-26T07:31:45.872603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.845651+0000","last_change":"2024-04-26T07:30:56.845747+0000","last_active":"2024-04-26T07:30:56.845651+0000","last_peered":"2024-04-26T07:30:56.845651+0000","last_clean":"2024-04-26T07:30:56.845651+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:30:56.845651+0000","last_undegraded":"2024-04-26T07:30:56.845651+0000","last_fullsized":"2024-04-26T07:30:56.845651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.845650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.427936+0000","last_change":"2024-04-26T07:30:42.428022+0000","last_active":"2024-04-26T07:30:42.427936+0000","last_peered":"2024-04-26T07:30:42.427936+0000","last_clean":"2024-04-26T07:30:42.427936+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:30:42.427936+0000","last_undegraded":"2024-04-26T07:30:42.427936+0000","last_fullsized":"2024-04-26T07:30:42.427936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.427935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'15","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:18.834721+0000","last_change":"2024-04-26T07:30:18.834800+0000","last_active":"2024-04-26T07:30:18.834721+0000","last_peered":"2024-04-26T07:30:18.834721+0000","last_clean":"2024-04-26T07:30:18.834721+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:30:18.834721+0000","last_undegraded":"2024-04-26T07:30:18.834721+0000","last_fullsized":"2024-04-26T07:30:18.834721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'15","last_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_deep_scrub":"19'15","last_deep_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_clean_scrub_stamp":"2024-04-26T07:30:18.834720+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:47.891030+0000","last_change":"2024-04-26T07:31:47.891117+0000","last_active":"2024-04-26T07:31:47.891030+0000","last_peered":"2024-04-26T07:31:47.891030+0000","last_clean":"2024-04-26T07:31:47.891030+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:31:47.891030+0000","last_undegraded":"2024-04-26T07:31:47.891030+0000","last_fullsized":"2024-04-26T07:31:47.891030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:47.891030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:47.891030+0000","last_clean_scrub_stamp":"2024-04-26T07:31:47.891030+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.546240+0000","last_change":"2024-04-26T07:30:20.546354+0000","last_active":"2024-04-26T07:30:20.546240+0000","last_peered":"2024-04-26T07:30:20.546240+0000","last_clean":"2024-04-26T07:30:20.546240+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:30:20.546240+0000","last_undegraded":"2024-04-26T07:30:20.546240+0000","last_fullsized":"2024-04-26T07:30:20.546240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.546239+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:30.819563+0000","last_change":"2024-04-26T07:31:30.819662+0000","last_active":"2024-04-26T07:31:30.819563+0000","last_peered":"2024-04-26T07:31:30.819563+0000","last_clean":"2024-04-26T07:31:30.819563+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:31:30.819563+0000","last_undegraded":"2024-04-26T07:31:30.819563+0000","last_fullsized":"2024-04-26T07:31:30.819563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:30.819563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:30.819563+0000","last_clean_scrub_stamp":"2024-04-26T07:31:30.819563+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:13.068833+0000","last_change":"2024-04-26T07:30:13.068913+0000","last_active":"2024-04-26T07:30:13.068833+0000","last_peered":"2024-04-26T07:30:13.068833+0000","last_clean":"2024-04-26T07:30:13.068833+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:30:13.068833+0000","last_undegraded":"2024-04-26T07:30:13.068833+0000","last_fullsized":"2024-04-26T07:30:13.068833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:13.068832+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.955449+0000","last_change":"2024-04-26T07:30:38.955557+0000","last_active":"2024-04-26T07:30:38.955449+0000","last_peered":"2024-04-26T07:30:38.955449+0000","last_clean":"2024-04-26T07:30:38.955449+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:30:38.955449+0000","last_undegraded":"2024-04-26T07:30:38.955449+0000","last_fullsized":"2024-04-26T07:30:38.955449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.955449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.700832+0000","last_change":"2024-04-26T07:30:51.700910+0000","last_active":"2024-04-26T07:30:51.700832+0000","last_peered":"2024-04-26T07:30:51.700832+0000","last_clean":"2024-04-26T07:30:51.700832+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:30:51.700832+0000","last_undegraded":"2024-04-26T07:30:51.700832+0000","last_fullsized":"2024-04-26T07:30:51.700832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.700832+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.148236+0000","last_change":"2024-04-26T07:30:20.148325+0000","last_active":"2024-04-26T07:30:20.148236+0000","last_peered":"2024-04-26T07:30:20.148236+0000","last_clean":"2024-04-26T07:30:20.148236+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:30:20.148236+0000","last_undegraded":"2024-04-26T07:30:20.148236+0000","last_fullsized":"2024-04-26T07:30:20.148236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.148235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.511807+0000","last_change":"2024-04-26T07:30:16.511900+0000","last_active":"2024-04-26T07:30:16.511807+0000","last_peered":"2024-04-26T07:30:16.511807+0000","last_clean":"2024-04-26T07:30:16.511807+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:30:16.511807+0000","last_undegraded":"2024-04-26T07:30:16.511807+0000","last_fullsized":"2024-04-26T07:30:16.511807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.511806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:34.479850+0000","last_change":"2024-04-26T07:30:34.479942+0000","last_active":"2024-04-26T07:30:34.479850+0000","last_peered":"2024-04-26T07:30:34.479850+0000","last_clean":"2024-04-26T07:30:34.479850+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:30:34.479850+0000","last_undegraded":"2024-04-26T07:30:34.479850+0000","last_fullsized":"2024-04-26T07:30:34.479850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_clean_scrub_stamp":"2024-04-26T07:30:34.479849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:49.675793+0000","last_change":"2024-04-26T07:30:49.675867+0000","last_active":"2024-04-26T07:30:49.675793+0000","last_peered":"2024-04-26T07:30:49.675793+0000","last_clean":"2024-04-26T07:30:49.675793+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:30:49.675793+0000","last_undegraded":"2024-04-26T07:30:49.675793+0000","last_fullsized":"2024-04-26T07:30:49.675793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_clean_scrub_stamp":"2024-04-26T07:30:49.675793+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.454434+0000","last_change":"2024-04-26T07:30:38.454554+0000","last_active":"2024-04-26T07:30:38.454434+0000","last_peered":"2024-04-26T07:30:38.454434+0000","last_clean":"2024-04-26T07:30:38.454434+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:30:38.454434+0000","last_undegraded":"2024-04-26T07:30:38.454434+0000","last_fullsized":"2024-04-26T07:30:38.454434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.454433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.698682+0000","last_change":"2024-04-26T07:30:42.698763+0000","last_active":"2024-04-26T07:30:42.698682+0000","last_peered":"2024-04-26T07:30:42.698682+0000","last_clean":"2024-04-26T07:30:42.698682+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:30:42.698682+0000","last_undegraded":"2024-04-26T07:30:42.698682+0000","last_fullsized":"2024-04-26T07:30:42.698682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.698682+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:33.855842+0000","last_change":"2024-04-26T07:31:33.855936+0000","last_active":"2024-04-26T07:31:33.855842+0000","last_peered":"2024-04-26T07:31:33.855842+0000","last_clean":"2024-04-26T07:31:33.855842+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:31:33.855842+0000","last_undegraded":"2024-04-26T07:31:33.855842+0000","last_fullsized":"2024-04-26T07:31:33.855842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:33.855841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:33.855841+0000","last_clean_scrub_stamp":"2024-04-26T07:31:33.855841+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:35.647109+0000","last_change":"2024-04-26T07:30:35.647193+0000","last_active":"2024-04-26T07:30:35.647109+0000","last_peered":"2024-04-26T07:30:35.647109+0000","last_clean":"2024-04-26T07:30:35.647109+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:30:35.647109+0000","last_undegraded":"2024-04-26T07:30:35.647109+0000","last_fullsized":"2024-04-26T07:30:35.647109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_clean_scrub_stamp":"2024-04-26T07:30:35.647108+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.207071+0000","last_change":"2024-04-26T07:30:25.207160+0000","last_active":"2024-04-26T07:30:25.207071+0000","last_peered":"2024-04-26T07:30:25.207071+0000","last_clean":"2024-04-26T07:30:25.207071+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:30:25.207071+0000","last_undegraded":"2024-04-26T07:30:25.207071+0000","last_fullsized":"2024-04-26T07:30:25.207071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.207070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.679673+0000","last_change":"2024-04-26T07:30:33.679748+0000","last_active":"2024-04-26T07:30:33.679673+0000","last_peered":"2024-04-26T07:30:33.679673+0000","last_clean":"2024-04-26T07:30:33.679673+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:30:33.679673+0000","last_undegraded":"2024-04-26T07:30:33.679673+0000","last_fullsized":"2024-04-26T07:30:33.679673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.679672+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:43.016723+0000","last_change":"2024-04-26T07:30:43.016816+0000","last_active":"2024-04-26T07:30:43.016723+0000","last_peered":"2024-04-26T07:30:43.016723+0000","last_clean":"2024-04-26T07:30:43.016723+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:30:43.016723+0000","last_undegraded":"2024-04-26T07:30:43.016723+0000","last_fullsized":"2024-04-26T07:30:43.016723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:43.016723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.867473+0000","last_change":"2024-04-26T07:30:09.867557+0000","last_active":"2024-04-26T07:30:09.867473+0000","last_peered":"2024-04-26T07:30:09.867473+0000","last_clean":"2024-04-26T07:30:09.867473+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:30:09.867473+0000","last_undegraded":"2024-04-26T07:30:09.867473+0000","last_fullsized":"2024-04-26T07:30:09.867473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.867473+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.023356+0000","last_change":"2024-04-26T07:30:11.023477+0000","last_active":"2024-04-26T07:30:11.023356+0000","last_peered":"2024-04-26T07:30:11.023356+0000","last_clean":"2024-04-26T07:30:11.023356+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:30:11.023356+0000","last_undegraded":"2024-04-26T07:30:11.023356+0000","last_fullsized":"2024-04-26T07:30:11.023356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.023356+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:30.811830+0000","last_change":"2024-04-26T07:30:30.811917+0000","last_active":"2024-04-26T07:30:30.811830+0000","last_peered":"2024-04-26T07:30:30.811830+0000","last_clean":"2024-04-26T07:30:30.811830+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:30:30.811830+0000","last_undegraded":"2024-04-26T07:30:30.811830+0000","last_fullsized":"2024-04-26T07:30:30.811830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_clean_scrub_stamp":"2024-04-26T07:30:30.811830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:14.491026+0000","last_change":"2024-04-26T07:30:14.491123+0000","last_active":"2024-04-26T07:30:14.491026+0000","last_peered":"2024-04-26T07:30:14.491026+0000","last_clean":"2024-04-26T07:30:14.491026+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:30:14.491026+0000","last_undegraded":"2024-04-26T07:30:14.491026+0000","last_fullsized":"2024-04-26T07:30:14.491026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_clean_scrub_stamp":"2024-04-26T07:30:14.491025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.413359+0000","last_change":"2024-04-26T07:30:09.413441+0000","last_active":"2024-04-26T07:30:09.413359+0000","last_peered":"2024-04-26T07:30:09.413359+0000","last_clean":"2024-04-26T07:30:09.413359+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:30:09.413359+0000","last_undegraded":"2024-04-26T07:30:09.413359+0000","last_fullsized":"2024-04-26T07:30:09.413359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.413358+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.849915+0000","last_change":"2024-04-26T07:30:31.850005+0000","last_active":"2024-04-26T07:30:31.849915+0000","last_peered":"2024-04-26T07:30:31.849915+0000","last_clean":"2024-04-26T07:30:31.849915+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:30:31.849915+0000","last_undegraded":"2024-04-26T07:30:31.849915+0000","last_fullsized":"2024-04-26T07:30:31.849915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.849914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.028509+0000","last_change":"2024-04-26T07:30:08.028621+0000","last_active":"2024-04-26T07:30:08.028509+0000","last_peered":"2024-04-26T07:30:08.028509+0000","last_clean":"2024-04-26T07:30:08.028509+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:30:08.028509+0000","last_undegraded":"2024-04-26T07:30:08.028509+0000","last_fullsized":"2024-04-26T07:30:08.028509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.028509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.809606+0000","last_change":"2024-04-26T07:30:12.809726+0000","last_active":"2024-04-26T07:30:12.809606+0000","last_peered":"2024-04-26T07:30:12.809606+0000","last_clean":"2024-04-26T07:30:12.809606+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:30:12.809606+0000","last_undegraded":"2024-04-26T07:30:12.809606+0000","last_fullsized":"2024-04-26T07:30:12.809606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.809605+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.923160+0000","last_change":"2024-04-26T07:30:33.923250+0000","last_active":"2024-04-26T07:30:33.923160+0000","last_peered":"2024-04-26T07:30:33.923160+0000","last_clean":"2024-04-26T07:30:33.923160+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:30:33.923160+0000","last_undegraded":"2024-04-26T07:30:33.923160+0000","last_fullsized":"2024-04-26T07:30:33.923160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.923160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.443421+0000","last_change":"2024-04-26T07:30:15.443501+0000","last_active":"2024-04-26T07:30:15.443421+0000","last_peered":"2024-04-26T07:30:15.443421+0000","last_clean":"2024-04-26T07:30:15.443421+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:30:15.443421+0000","last_undegraded":"2024-04-26T07:30:15.443421+0000","last_fullsized":"2024-04-26T07:30:15.443421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.443421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.891685+0000","last_change":"2024-04-26T07:30:08.891750+0000","last_active":"2024-04-26T07:30:08.891685+0000","last_peered":"2024-04-26T07:30:08.891685+0000","last_clean":"2024-04-26T07:30:08.891685+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:30:08.891685+0000","last_undegraded":"2024-04-26T07:30:08.891685+0000","last_fullsized":"2024-04-26T07:30:08.891685+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.891685+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.436730+0000","last_change":"2024-04-26T07:30:20.436817+0000","last_active":"2024-04-26T07:30:20.436730+0000","last_peered":"2024-04-26T07:30:20.436730+0000","last_clean":"2024-04-26T07:30:20.436730+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:30:20.436730+0000","last_undegraded":"2024-04-26T07:30:20.436730+0000","last_fullsized":"2024-04-26T07:30:20.436730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.436730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:29.840859+0000","last_change":"2024-04-26T07:31:29.840933+0000","last_active":"2024-04-26T07:31:29.840859+0000","last_peered":"2024-04-26T07:31:29.840859+0000","last_clean":"2024-04-26T07:31:29.840859+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:31:29.840859+0000","last_undegraded":"2024-04-26T07:31:29.840859+0000","last_fullsized":"2024-04-26T07:31:29.840859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:29.840858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:29.840858+0000","last_clean_scrub_stamp":"2024-04-26T07:31:29.840858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.493074+0000","last_change":"2024-04-26T07:30:12.493165+0000","last_active":"2024-04-26T07:30:12.493074+0000","last_peered":"2024-04-26T07:30:12.493074+0000","last_clean":"2024-04-26T07:30:12.493074+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:30:12.493074+0000","last_undegraded":"2024-04-26T07:30:12.493074+0000","last_fullsized":"2024-04-26T07:30:12.493074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.493074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.440210+0000","last_change":"2024-04-26T07:30:08.440323+0000","last_active":"2024-04-26T07:30:08.440210+0000","last_peered":"2024-04-26T07:30:08.440210+0000","last_clean":"2024-04-26T07:30:08.440210+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:30:08.440210+0000","last_undegraded":"2024-04-26T07:30:08.440210+0000","last_fullsized":"2024-04-26T07:30:08.440210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.440209+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.503368+0000","last_change":"2024-04-26T07:30:33.503463+0000","last_active":"2024-04-26T07:30:33.503368+0000","last_peered":"2024-04-26T07:30:33.503368+0000","last_clean":"2024-04-26T07:30:33.503368+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:30:33.503368+0000","last_undegraded":"2024-04-26T07:30:33.503368+0000","last_fullsized":"2024-04-26T07:30:33.503368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.503367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.416586+0000","last_change":"2024-04-26T07:30:16.416716+0000","last_active":"2024-04-26T07:30:16.416586+0000","last_peered":"2024-04-26T07:30:16.416586+0000","last_clean":"2024-04-26T07:30:16.416586+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:30:16.416586+0000","last_undegraded":"2024-04-26T07:30:16.416586+0000","last_fullsized":"2024-04-26T07:30:16.416586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.416585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.810615+0000","last_change":"2024-04-26T07:30:16.810700+0000","last_active":"2024-04-26T07:30:16.810615+0000","last_peered":"2024-04-26T07:30:16.810615+0000","last_clean":"2024-04-26T07:30:16.810615+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:30:16.810615+0000","last_undegraded":"2024-04-26T07:30:16.810615+0000","last_fullsized":"2024-04-26T07:30:16.810615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.810615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.538993+0000","last_change":"2024-04-26T07:30:32.539075+0000","last_active":"2024-04-26T07:30:32.538993+0000","last_peered":"2024-04-26T07:30:32.538993+0000","last_clean":"2024-04-26T07:30:32.538993+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:30:32.538993+0000","last_undegraded":"2024-04-26T07:30:32.538993+0000","last_fullsized":"2024-04-26T07:30:32.538993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.538992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:28.602216+0000","last_change":"2024-04-26T07:30:28.602296+0000","last_active":"2024-04-26T07:30:28.602216+0000","last_peered":"2024-04-26T07:30:28.602216+0000","last_clean":"2024-04-26T07:30:28.602216+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:30:28.602216+0000","last_undegraded":"2024-04-26T07:30:28.602216+0000","last_fullsized":"2024-04-26T07:30:28.602216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_clean_scrub_stamp":"2024-04-26T07:30:28.602216+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.818279+0000","last_change":"2024-04-26T07:30:11.818359+0000","last_active":"2024-04-26T07:30:11.818279+0000","last_peered":"2024-04-26T07:30:11.818279+0000","last_clean":"2024-04-26T07:30:11.818279+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:30:11.818279+0000","last_undegraded":"2024-04-26T07:30:11.818279+0000","last_fullsized":"2024-04-26T07:30:11.818279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.818278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:28.829091+0000","last_change":"2024-04-26T07:31:28.829177+0000","last_active":"2024-04-26T07:31:28.829091+0000","last_peered":"2024-04-26T07:31:28.829091+0000","last_clean":"2024-04-26T07:31:28.829091+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:31:28.829091+0000","last_undegraded":"2024-04-26T07:31:28.829091+0000","last_fullsized":"2024-04-26T07:31:28.829091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:28.829091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:28.829091+0000","last_clean_scrub_stamp":"2024-04-26T07:31:28.829091+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:17.377065+0000","last_change":"2024-04-26T07:30:17.377162+0000","last_active":"2024-04-26T07:30:17.377065+0000","last_peered":"2024-04-26T07:30:17.377065+0000","last_clean":"2024-04-26T07:30:17.377065+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:30:17.377065+0000","last_undegraded":"2024-04-26T07:30:17.377065+0000","last_fullsized":"2024-04-26T07:30:17.377065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_clean_scrub_stamp":"2024-04-26T07:30:17.377064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.414289+0000","last_change":"2024-04-26T07:30:11.414367+0000","last_active":"2024-04-26T07:30:11.414289+0000","last_peered":"2024-04-26T07:30:11.414289+0000","last_clean":"2024-04-26T07:30:11.414289+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:30:11.414289+0000","last_undegraded":"2024-04-26T07:30:11.414289+0000","last_fullsized":"2024-04-26T07:30:11.414289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.414288+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:19.136227+0000","last_change":"2024-04-26T07:30:19.136319+0000","last_active":"2024-04-26T07:30:19.136227+0000","last_peered":"2024-04-26T07:30:19.136227+0000","last_clean":"2024-04-26T07:30:19.136227+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:30:19.136227+0000","last_undegraded":"2024-04-26T07:30:19.136227+0000","last_fullsized":"2024-04-26T07:30:19.136227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:19.136226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'12","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:29.574126+0000","last_change":"2024-04-26T07:30:29.574207+0000","last_active":"2024-04-26T07:30:29.574126+0000","last_peered":"2024-04-26T07:30:29.574126+0000","last_clean":"2024-04-26T07:30:29.574126+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:30:29.574126+0000","last_undegraded":"2024-04-26T07:30:29.574126+0000","last_fullsized":"2024-04-26T07:30:29.574126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_clean_scrub_stamp":"2024-04-26T07:30:29.574125+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:39.295620+0000","last_change":"2024-04-26T07:30:39.295711+0000","last_active":"2024-04-26T07:30:39.295620+0000","last_peered":"2024-04-26T07:30:39.295620+0000","last_clean":"2024-04-26T07:30:39.295620+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:30:39.295620+0000","last_undegraded":"2024-04-26T07:30:39.295620+0000","last_fullsized":"2024-04-26T07:30:39.295620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_clean_scrub_stamp":"2024-04-26T07:30:39.295619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.788374+0000","last_change":"2024-04-26T07:30:27.788453+0000","last_active":"2024-04-26T07:30:27.788374+0000","last_peered":"2024-04-26T07:30:27.788374+0000","last_clean":"2024-04-26T07:30:27.788374+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:30:27.788374+0000","last_undegraded":"2024-04-26T07:30:27.788374+0000","last_fullsized":"2024-04-26T07:30:27.788374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.788374+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:36.226727+0000","last_change":"2024-04-26T07:30:36.226816+0000","last_active":"2024-04-26T07:30:36.226727+0000","last_peered":"2024-04-26T07:30:36.226727+0000","last_clean":"2024-04-26T07:30:36.226727+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:30:36.226727+0000","last_undegraded":"2024-04-26T07:30:36.226727+0000","last_fullsized":"2024-04-26T07:30:36.226727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_clean_scrub_stamp":"2024-04-26T07:30:36.226726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:11.969596+0000","last_change":"2024-04-26T07:31:11.969715+0000","last_active":"2024-04-26T07:31:11.969596+0000","last_peered":"2024-04-26T07:31:11.969596+0000","last_clean":"2024-04-26T07:31:11.969596+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:31:11.969596+0000","last_undegraded":"2024-04-26T07:31:11.969596+0000","last_fullsized":"2024-04-26T07:31:11.969596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:31:11.969596+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:31:11.969596+0000","last_clean_scrub_stamp":"2024-04-26T07:31:11.969596+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.249230+0000","last_change":"2024-04-26T07:30:32.249320+0000","last_active":"2024-04-26T07:30:32.249230+0000","last_peered":"2024-04-26T07:30:32.249230+0000","last_clean":"2024-04-26T07:30:32.249230+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:30:32.249230+0000","last_undegraded":"2024-04-26T07:30:32.249230+0000","last_fullsized":"2024-04-26T07:30:32.249230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.249230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:18.959835+0000","last_change":"2024-04-26T07:31:18.959927+0000","last_active":"2024-04-26T07:31:18.959835+0000","last_peered":"2024-04-26T07:31:18.959835+0000","last_clean":"2024-04-26T07:31:18.959835+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:31:18.959835+0000","last_undegraded":"2024-04-26T07:31:18.959835+0000","last_fullsized":"2024-04-26T07:31:18.959835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:31:18.959834+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:31:18.959834+0000","last_clean_scrub_stamp":"2024-04-26T07:31:18.959834+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:48.895395+0000","last_change":"2024-04-26T07:31:48.895491+0000","last_active":"2024-04-26T07:31:48.895395+0000","last_peered":"2024-04-26T07:31:48.895395+0000","last_clean":"2024-04-26T07:31:48.895395+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:31:48.895395+0000","last_undegraded":"2024-04-26T07:31:48.895395+0000","last_fullsized":"2024-04-26T07:31:48.895395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:48.895394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:48.895394+0000","last_clean_scrub_stamp":"2024-04-26T07:31:48.895394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.561764+0000","last_change":"2024-04-26T07:30:31.561845+0000","last_active":"2024-04-26T07:30:31.561764+0000","last_peered":"2024-04-26T07:30:31.561764+0000","last_clean":"2024-04-26T07:30:31.561764+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:30:31.561764+0000","last_undegraded":"2024-04-26T07:30:31.561764+0000","last_fullsized":"2024-04-26T07:30:31.561764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.561764+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.216511+0000","last_change":"2024-04-26T07:30:31.216609+0000","last_active":"2024-04-26T07:30:31.216511+0000","last_peered":"2024-04-26T07:30:31.216511+0000","last_clean":"2024-04-26T07:30:31.216511+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:30:31.216511+0000","last_undegraded":"2024-04-26T07:30:31.216511+0000","last_fullsized":"2024-04-26T07:30:31.216511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.216510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.967952+0000","last_change":"2024-04-26T07:30:44.968081+0000","last_active":"2024-04-26T07:30:44.967952+0000","last_peered":"2024-04-26T07:30:44.967952+0000","last_clean":"2024-04-26T07:30:44.967952+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:30:44.967952+0000","last_undegraded":"2024-04-26T07:30:44.967952+0000","last_fullsized":"2024-04-26T07:30:44.967952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.967951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:56.957441+0000","last_change":"2024-04-26T07:31:56.957535+0000","last_active":"2024-04-26T07:31:56.957441+0000","last_peered":"2024-04-26T07:31:56.957441+0000","last_clean":"2024-04-26T07:31:56.957441+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:31:56.957441+0000","last_undegraded":"2024-04-26T07:31:56.957441+0000","last_fullsized":"2024-04-26T07:31:56.957441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:56.957441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:56.957441+0000","last_clean_scrub_stamp":"2024-04-26T07:31:56.957441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.450558+0000","last_change":"2024-04-26T07:30:50.450657+0000","last_active":"2024-04-26T07:30:50.450558+0000","last_peered":"2024-04-26T07:30:50.450558+0000","last_clean":"2024-04-26T07:30:50.450558+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:30:50.450558+0000","last_undegraded":"2024-04-26T07:30:50.450558+0000","last_fullsized":"2024-04-26T07:30:50.450558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.450557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:02.940556+0000","last_change":"2024-04-26T07:32:02.940658+0000","last_active":"2024-04-26T07:32:02.940556+0000","last_peered":"2024-04-26T07:32:02.940556+0000","last_clean":"2024-04-26T07:32:02.940556+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:32:02.940556+0000","last_undegraded":"2024-04-26T07:32:02.940556+0000","last_fullsized":"2024-04-26T07:32:02.940556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:02.940555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:02.940555+0000","last_clean_scrub_stamp":"2024-04-26T07:32:02.940555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:46.936609+0000","last_change":"2024-04-26T07:30:46.936704+0000","last_active":"2024-04-26T07:30:46.936609+0000","last_peered":"2024-04-26T07:30:46.936609+0000","last_clean":"2024-04-26T07:30:46.936609+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:30:46.936609+0000","last_undegraded":"2024-04-26T07:30:46.936609+0000","last_fullsized":"2024-04-26T07:30:46.936609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_clean_scrub_stamp":"2024-04-26T07:30:46.936608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705712,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.27900000000000003,"15min":0.27000000000000002},"min":{"1min":0.21199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.30299999999999999,"15min":0.29899999999999999},"min":{"1min":0.215,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.313,"15min":0.308},"min":{"1min":0.21199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.31,"15min":0.30599999999999999},"min":{"1min":0.23799999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27500000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.317,"15min":0.313},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.28799999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.28999999999999998,"15min":0.28699999999999998},"min":{"1min":0.222,"5min":0.16,"15min":0.16},"max":{"1min":0.41999999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.308},"min":{"1min":0.22800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.432,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.38900000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.498,"5min":0.503,"15min":0.503},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.30299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.28799999999999998,"15min":0.27300000000000002},"min":{"1min":0.26900000000000002,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.45000000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.29199999999999998},"min":{"1min":0.23999999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.47299999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.32500000000000001,"15min":0.315},"min":{"1min":0.27600000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.32500000000000001,"15min":0.313},"min":{"1min":0.25600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Apr 26 07:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.318},"min":{"1min":0.29799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.26400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.45000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.307}]}]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.29999999999999999},"min":{"1min":0.23599999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.439,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.32100000000000001},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48299999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.33700000000000002},"min":{"1min":0.249,"5min":0.193,"15min":0.193},"max":{"1min":0.47999999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.46400000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Apr 26 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.49199999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.30099999999999999}]}]}]}} 2024-04-26T07:32:10.294 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:32:10.294 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:32:10.295 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:28:30.812831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=28, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=30, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:32:10.296 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:32:30.297 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:32:30.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.417+0000 7efc3a008700 1 Processor -- start 2024-04-26T07:32:30.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.417+0000 7efc3a008700 1 -- start start 2024-04-26T07:32:30.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc3a008700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc341360f0 0x7efc34096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc3a008700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3405c080 0x7efc34141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc3a008700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340970a0 con 0x7efc3406c7d0 2024-04-26T07:32:30.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc3a008700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34133c10 con 0x7efc3405c080 2024-04-26T07:32:30.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc3a008700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc34096810 con 0x7efc341360f0 2024-04-26T07:32:30.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc33fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3405c080 0x7efc34141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc32ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc341360f0 0x7efc34096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc337fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efc3406c7d0 0x7efc3405b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51430/0 (socket says 172.21.15.31:51430) 2024-04-26T07:32:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc337fe700 1 -- 172.21.15.31:0/4142256334 learned_addr learned my addr 172.21.15.31:0/4142256334 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:32:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc33fff700 1 -- 172.21.15.31:0/4142256334 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc341360f0 msgr2=0x7efc34096320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc33fff700 1 --2- 172.21.15.31:0/4142256334 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc341360f0 0x7efc34096320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc33fff700 1 -- 172.21.15.31:0/4142256334 >> v1:172.21.15.31:6789/0 conn(0x7efc3406c7d0 legacy=0x7efc3405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc33fff700 1 -- 172.21.15.31:0/4142256334 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc341364d0 con 0x7efc3405c080 2024-04-26T07:32:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc32ffd700 1 --2- 172.21.15.31:0/4142256334 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc341360f0 0x7efc34096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc33fff700 1 --2- 172.21.15.31:0/4142256334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3405c080 0x7efc34141a50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7efc2c0032f0 tx=0x7efc2c0091d0).ready entity=mon.1 client_cookie=a2e72de9e3547648 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.418+0000 7efc327fc700 1 -- 172.21.15.31:0/4142256334 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c00b6c0 con 0x7efc3405c080 2024-04-26T07:32:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc327fc700 1 -- 172.21.15.31:0/4142256334 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c00b820 con 0x7efc3405c080 2024-04-26T07:32:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc327fc700 1 -- 172.21.15.31:0/4142256334 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c00b990 con 0x7efc3405c080 2024-04-26T07:32:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc3a008700 1 -- 172.21.15.31:0/4142256334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3405c080 msgr2=0x7efc34141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc3a008700 1 --2- 172.21.15.31:0/4142256334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3405c080 0x7efc34141a50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7efc2c0032f0 tx=0x7efc2c0091d0).stop 2024-04-26T07:32:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc3a008700 1 -- 172.21.15.31:0/4142256334 shutdown_connections 2024-04-26T07:32:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc3a008700 1 --2- 172.21.15.31:0/4142256334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc3405c080 0x7efc34141a50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc3a008700 1 --2- 172.21.15.31:0/4142256334 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc341360f0 0x7efc34096320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc3a008700 1 -- 172.21.15.31:0/4142256334 >> 172.21.15.31:0/4142256334 conn(0x7efc34061370 msgr2=0x7efc3406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc3a008700 1 -- 172.21.15.31:0/4142256334 shutdown_connections 2024-04-26T07:32:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.419+0000 7efc3a008700 1 -- 172.21.15.31:0/4142256334 wait complete. 2024-04-26T07:32:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.420+0000 7efc3a008700 1 Processor -- start 2024-04-26T07:32:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.420+0000 7efc3a008700 1 -- start start 2024-04-26T07:32:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc3a008700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3405c080 0x7efc34149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc3a008700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc3406c7d0 0x7efc340634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc3a008700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc341360f0 0x7efc340639e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc3a008700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34062270 con 0x7efc3405c080 2024-04-26T07:32:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc3a008700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34063250 con 0x7efc341360f0 2024-04-26T07:32:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc3a008700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc34064800 con 0x7efc3406c7d0 2024-04-26T07:32:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc337fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3405c080 0x7efc34149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc33fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc341360f0 0x7efc340639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc337fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3405c080 0x7efc34149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59216/0 (socket says 172.21.15.31:59216) 2024-04-26T07:32:30.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc337fe700 1 -- 172.21.15.31:0/3960101333 learned_addr learned my addr 172.21.15.31:0/3960101333 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:30.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc32ffd700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc3406c7d0 0x7efc340634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc33fff700 1 -- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc3406c7d0 msgr2=0x7efc340634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc33fff700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc3406c7d0 0x7efc340634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc33fff700 1 -- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3405c080 msgr2=0x7efc34149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc33fff700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3405c080 0x7efc34149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc33fff700 1 -- 172.21.15.31:0/3960101333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c00b180 con 0x7efc341360f0 2024-04-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc337fe700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3405c080 0x7efc34149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.421+0000 7efc33fff700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc341360f0 0x7efc340639e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7efc2c0032f0 tx=0x7efc2c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.422+0000 7efc30ff9700 1 -- 172.21.15.31:0/3960101333 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c00b6c0 con 0x7efc341360f0 2024-04-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.422+0000 7efc30ff9700 1 -- 172.21.15.31:0/3960101333 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c021630 con 0x7efc341360f0 2024-04-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.422+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c009470 con 0x7efc341360f0 2024-04-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.422+0000 7efc30ff9700 1 -- 172.21.15.31:0/3960101333 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c021990 con 0x7efc341360f0 2024-04-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.422+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3414a280 con 0x7efc341360f0 2024-04-26T07:32:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.423+0000 7efc30ff9700 1 -- 172.21.15.31:0/3960101333 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7efc2c027020 con 0x7efc341360f0 2024-04-26T07:32:30.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.423+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc34136780 con 0x7efc341360f0 2024-04-26T07:32:30.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.423+0000 7efc30ff9700 1 -- 172.21.15.31:0/3960101333 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efc2c04bbf0 con 0x7efc341360f0 2024-04-26T07:32:30.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.426+0000 7efc30ff9700 1 -- 172.21.15.31:0/3960101333 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7efc2c021d20 con 0x7efc341360f0 2024-04-26T07:32:30.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.537+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 --> v1:172.21.15.31:6816/39613 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc34097f90 con 0x7efc18038da0 2024-04-26T07:32:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.544+0000 7efc30ff9700 1 -- 172.21.15.31:0/3960101333 <== mgr.4106 v1:172.21.15.31:6816/39613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252298 (unknown 2965378022 0 1285576269) 0x7efc34097f90 con 0x7efc18038da0 2024-04-26T07:32:30.549 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:32:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 >> v1:172.21.15.31:6816/39613 conn(0x7efc18038da0 legacy=0x7efc1803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc341360f0 msgr2=0x7efc340639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc341360f0 0x7efc340639e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7efc2c0032f0 tx=0x7efc2c016000).stop 2024-04-26T07:32:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 shutdown_connections 2024-04-26T07:32:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc341360f0 0x7efc340639e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3405c080 0x7efc34149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 --2- 172.21.15.31:0/3960101333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc3406c7d0 0x7efc340634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 >> 172.21.15.31:0/3960101333 conn(0x7efc34061370 msgr2=0x7efc340a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 shutdown_connections 2024-04-26T07:32:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.546+0000 7efc3a008700 1 -- 172.21.15.31:0/3960101333 wait complete. 2024-04-26T07:32:30.553 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-26T07:32:30.558 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-04-26T07:32:30.029747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7997,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13536,"num_omap_keys":21,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":234850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002932"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.426802+0000","last_change":"2024-04-26T07:30:52.426911+0000","last_active":"2024-04-26T07:30:52.426802+0000","last_peered":"2024-04-26T07:30:52.426802+0000","last_clean":"2024-04-26T07:30:52.426802+0000","last_became_active":"2024-04-26T07:28:31.164172+0000","last_became_peered":"2024-04-26T07:28:31.164172+0000","last_unstale":"2024-04-26T07:30:52.426802+0000","last_undegraded":"2024-04-26T07:30:52.426802+0000","last_fullsized":"2024-04-26T07:30:52.426802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.426801+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.426801+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.387022+0000","last_change":"2024-04-26T07:30:51.387112+0000","last_active":"2024-04-26T07:30:51.387022+0000","last_peered":"2024-04-26T07:30:51.387022+0000","last_clean":"2024-04-26T07:30:51.387022+0000","last_became_active":"2024-04-26T07:28:31.158209+0000","last_became_peered":"2024-04-26T07:28:31.158209+0000","last_unstale":"2024-04-26T07:30:51.387022+0000","last_undegraded":"2024-04-26T07:30:51.387022+0000","last_fullsized":"2024-04-26T07:30:51.387022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:51.387021+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.387021+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:17.334912+0000","last_change":"2024-04-26T07:31:17.335002+0000","last_active":"2024-04-26T07:31:17.334912+0000","last_peered":"2024-04-26T07:31:17.334912+0000","last_clean":"2024-04-26T07:31:17.334912+0000","last_became_active":"2024-04-26T07:28:31.186057+0000","last_became_peered":"2024-04-26T07:28:31.186057+0000","last_unstale":"2024-04-26T07:31:17.334912+0000","last_undegraded":"2024-04-26T07:31:17.334912+0000","last_fullsized":"2024-04-26T07:31:17.334912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:17.334911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:17.334911+0000","last_clean_scrub_stamp":"2024-04-26T07:31:17.334911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:16.290874+0000","last_change":"2024-04-26T07:31:16.290972+0000","last_active":"2024-04-26T07:31:16.290874+0000","last_peered":"2024-04-26T07:31:16.290874+0000","last_clean":"2024-04-26T07:31:16.290874+0000","last_became_active":"2024-04-26T07:28:31.186121+0000","last_became_peered":"2024-04-26T07:28:31.186121+0000","last_unstale":"2024-04-26T07:31:16.290874+0000","last_undegraded":"2024-04-26T07:31:16.290874+0000","last_fullsized":"2024-04-26T07:31:16.290874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:16.290873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:16.290873+0000","last_clean_scrub_stamp":"2024-04-26T07:31:16.290873+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:13.357195+0000","last_change":"2024-04-26T07:31:13.357281+0000","last_active":"2024-04-26T07:31:13.357195+0000","last_peered":"2024-04-26T07:31:13.357195+0000","last_clean":"2024-04-26T07:31:13.357195+0000","last_became_active":"2024-04-26T07:28:31.168419+0000","last_became_peered":"2024-04-26T07:28:31.168419+0000","last_unstale":"2024-04-26T07:31:13.357195+0000","last_undegraded":"2024-04-26T07:31:13.357195+0000","last_fullsized":"2024-04-26T07:31:13.357195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:13.357195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:13.357195+0000","last_clean_scrub_stamp":"2024-04-26T07:31:13.357195+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:15.013660+0000","last_change":"2024-04-26T07:32:15.013793+0000","last_active":"2024-04-26T07:32:15.013660+0000","last_peered":"2024-04-26T07:32:15.013660+0000","last_clean":"2024-04-26T07:32:15.013660+0000","last_became_active":"2024-04-26T07:28:31.160523+0000","last_became_peered":"2024-04-26T07:28:31.160523+0000","last_unstale":"2024-04-26T07:32:15.013660+0000","last_undegraded":"2024-04-26T07:32:15.013660+0000","last_fullsized":"2024-04-26T07:32:15.013660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:15.013659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:15.013659+0000","last_clean_scrub_stamp":"2024-04-26T07:32:15.013659+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:12.966344+0000","last_change":"2024-04-26T07:32:12.966440+0000","last_active":"2024-04-26T07:32:12.966344+0000","last_peered":"2024-04-26T07:32:12.966344+0000","last_clean":"2024-04-26T07:32:12.966344+0000","last_became_active":"2024-04-26T07:28:31.173667+0000","last_became_peered":"2024-04-26T07:28:31.173667+0000","last_unstale":"2024-04-26T07:32:12.966344+0000","last_undegraded":"2024-04-26T07:32:12.966344+0000","last_fullsized":"2024-04-26T07:32:12.966344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:12.966343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:12.966343+0000","last_clean_scrub_stamp":"2024-04-26T07:32:12.966343+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:12.068148+0000","last_change":"2024-04-26T07:31:12.068229+0000","last_active":"2024-04-26T07:31:12.068148+0000","last_peered":"2024-04-26T07:31:12.068148+0000","last_clean":"2024-04-26T07:31:12.068148+0000","last_became_active":"2024-04-26T07:28:31.179262+0000","last_became_peered":"2024-04-26T07:28:31.179262+0000","last_unstale":"2024-04-26T07:31:12.068148+0000","last_undegraded":"2024-04-26T07:31:12.068148+0000","last_fullsized":"2024-04-26T07:31:12.068148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:12.068147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:12.068147+0000","last_clean_scrub_stamp":"2024-04-26T07:31:12.068147+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:12.351167+0000","last_change":"2024-04-26T07:31:12.351287+0000","last_active":"2024-04-26T07:31:12.351167+0000","last_peered":"2024-04-26T07:31:12.351167+0000","last_clean":"2024-04-26T07:31:12.351167+0000","last_became_active":"2024-04-26T07:28:31.169565+0000","last_became_peered":"2024-04-26T07:28:31.169565+0000","last_unstale":"2024-04-26T07:31:12.351167+0000","last_undegraded":"2024-04-26T07:31:12.351167+0000","last_fullsized":"2024-04-26T07:31:12.351167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:12.351167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:12.351167+0000","last_clean_scrub_stamp":"2024-04-26T07:31:12.351167+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.047204+0000","last_change":"2024-04-26T07:31:06.047291+0000","last_active":"2024-04-26T07:31:06.047204+0000","last_peered":"2024-04-26T07:31:06.047204+0000","last_clean":"2024-04-26T07:31:06.047204+0000","last_became_active":"2024-04-26T07:28:31.177931+0000","last_became_peered":"2024-04-26T07:28:31.177931+0000","last_unstale":"2024-04-26T07:31:06.047204+0000","last_undegraded":"2024-04-26T07:31:06.047204+0000","last_fullsized":"2024-04-26T07:31:06.047204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.047203+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.047203+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:04.079986+0000","last_change":"2024-04-26T07:31:04.080077+0000","last_active":"2024-04-26T07:31:04.079986+0000","last_peered":"2024-04-26T07:31:04.079986+0000","last_clean":"2024-04-26T07:31:04.079986+0000","last_became_active":"2024-04-26T07:28:31.178235+0000","last_became_peered":"2024-04-26T07:28:31.178235+0000","last_unstale":"2024-04-26T07:31:04.079986+0000","last_undegraded":"2024-04-26T07:31:04.079986+0000","last_fullsized":"2024-04-26T07:31:04.079986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:04.079985+0000","last_clean_scrub_stamp":"2024-04-26T07:31:04.079985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:47.333000+0000","last_change":"2024-04-26T07:30:47.333131+0000","last_active":"2024-04-26T07:30:47.333000+0000","last_peered":"2024-04-26T07:30:47.333000+0000","last_clean":"2024-04-26T07:30:47.333000+0000","last_became_active":"2024-04-26T07:28:31.166519+0000","last_became_peered":"2024-04-26T07:28:31.166519+0000","last_unstale":"2024-04-26T07:30:47.333000+0000","last_undegraded":"2024-04-26T07:30:47.333000+0000","last_fullsized":"2024-04-26T07:30:47.333000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:47.333000+0000","last_clean_scrub_stamp":"2024-04-26T07:30:47.333000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.307226+0000","last_change":"2024-04-26T07:30:42.307331+0000","last_active":"2024-04-26T07:30:42.307226+0000","last_peered":"2024-04-26T07:30:42.307226+0000","last_clean":"2024-04-26T07:30:42.307226+0000","last_became_active":"2024-04-26T07:28:31.165876+0000","last_became_peered":"2024-04-26T07:28:31.165876+0000","last_unstale":"2024-04-26T07:30:42.307226+0000","last_undegraded":"2024-04-26T07:30:42.307226+0000","last_fullsized":"2024-04-26T07:30:42.307226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.307226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.307226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:00.092689+0000","last_change":"2024-04-26T07:31:00.092776+0000","last_active":"2024-04-26T07:31:00.092689+0000","last_peered":"2024-04-26T07:31:00.092689+0000","last_clean":"2024-04-26T07:31:00.092689+0000","last_became_active":"2024-04-26T07:28:31.159176+0000","last_became_peered":"2024-04-26T07:28:31.159176+0000","last_unstale":"2024-04-26T07:31:00.092689+0000","last_undegraded":"2024-04-26T07:31:00.092689+0000","last_fullsized":"2024-04-26T07:31:00.092689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:00.092689+0000","last_clean_scrub_stamp":"2024-04-26T07:31:00.092689+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:10.341169+0000","last_change":"2024-04-26T07:31:10.341266+0000","last_active":"2024-04-26T07:31:10.341169+0000","last_peered":"2024-04-26T07:31:10.341169+0000","last_clean":"2024-04-26T07:31:10.341169+0000","last_became_active":"2024-04-26T07:28:31.186099+0000","last_became_peered":"2024-04-26T07:28:31.186099+0000","last_unstale":"2024-04-26T07:31:10.341169+0000","last_undegraded":"2024-04-26T07:31:10.341169+0000","last_fullsized":"2024-04-26T07:31:10.341169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:10.341168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:10.341168+0000","last_clean_scrub_stamp":"2024-04-26T07:31:10.341168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:09.979397+0000","last_change":"2024-04-26T07:32:09.979488+0000","last_active":"2024-04-26T07:32:09.979397+0000","last_peered":"2024-04-26T07:32:09.979397+0000","last_clean":"2024-04-26T07:32:09.979397+0000","last_became_active":"2024-04-26T07:28:31.174079+0000","last_became_peered":"2024-04-26T07:28:31.174079+0000","last_unstale":"2024-04-26T07:32:09.979397+0000","last_undegraded":"2024-04-26T07:32:09.979397+0000","last_fullsized":"2024-04-26T07:32:09.979397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:09.979397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:09.979397+0000","last_clean_scrub_stamp":"2024-04-26T07:32:09.979397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:06.307189+0000","last_change":"2024-04-26T07:31:06.307276+0000","last_active":"2024-04-26T07:31:06.307189+0000","last_peered":"2024-04-26T07:31:06.307189+0000","last_clean":"2024-04-26T07:31:06.307189+0000","last_became_active":"2024-04-26T07:28:31.177840+0000","last_became_peered":"2024-04-26T07:28:31.177840+0000","last_unstale":"2024-04-26T07:31:06.307189+0000","last_undegraded":"2024-04-26T07:31:06.307189+0000","last_fullsized":"2024-04-26T07:31:06.307189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:06.307188+0000","last_clean_scrub_stamp":"2024-04-26T07:31:06.307188+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:59.385202+0000","last_change":"2024-04-26T07:30:59.385291+0000","last_active":"2024-04-26T07:30:59.385202+0000","last_peered":"2024-04-26T07:30:59.385202+0000","last_clean":"2024-04-26T07:30:59.385202+0000","last_became_active":"2024-04-26T07:28:31.175557+0000","last_became_peered":"2024-04-26T07:28:31.175557+0000","last_unstale":"2024-04-26T07:30:59.385202+0000","last_undegraded":"2024-04-26T07:30:59.385202+0000","last_fullsized":"2024-04-26T07:30:59.385202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:59.385201+0000","last_clean_scrub_stamp":"2024-04-26T07:30:59.385201+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:40.294718+0000","last_change":"2024-04-26T07:30:40.294811+0000","last_active":"2024-04-26T07:30:40.294718+0000","last_peered":"2024-04-26T07:30:40.294718+0000","last_clean":"2024-04-26T07:30:40.294718+0000","last_became_active":"2024-04-26T07:28:31.160783+0000","last_became_peered":"2024-04-26T07:28:31.160783+0000","last_unstale":"2024-04-26T07:30:40.294718+0000","last_undegraded":"2024-04-26T07:30:40.294718+0000","last_fullsized":"2024-04-26T07:30:40.294718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:40.294717+0000","last_clean_scrub_stamp":"2024-04-26T07:30:40.294717+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.022023+0000","last_change":"2024-04-26T07:30:56.022116+0000","last_active":"2024-04-26T07:30:56.022023+0000","last_peered":"2024-04-26T07:30:56.022023+0000","last_clean":"2024-04-26T07:30:56.022023+0000","last_became_active":"2024-04-26T07:28:31.173906+0000","last_became_peered":"2024-04-26T07:28:31.173906+0000","last_unstale":"2024-04-26T07:30:56.022023+0000","last_undegraded":"2024-04-26T07:30:56.022023+0000","last_fullsized":"2024-04-26T07:30:56.022023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.022022+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.022022+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:55.027604+0000","last_change":"2024-04-26T07:30:55.027705+0000","last_active":"2024-04-26T07:30:55.027604+0000","last_peered":"2024-04-26T07:30:55.027604+0000","last_clean":"2024-04-26T07:30:55.027604+0000","last_became_active":"2024-04-26T07:28:31.174207+0000","last_became_peered":"2024-04-26T07:28:31.174207+0000","last_unstale":"2024-04-26T07:30:55.027604+0000","last_undegraded":"2024-04-26T07:30:55.027604+0000","last_fullsized":"2024-04-26T07:30:55.027604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:55.027603+0000","last_clean_scrub_stamp":"2024-04-26T07:30:55.027603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:52.447536+0000","last_change":"2024-04-26T07:30:52.447634+0000","last_active":"2024-04-26T07:30:52.447536+0000","last_peered":"2024-04-26T07:30:52.447536+0000","last_clean":"2024-04-26T07:30:52.447536+0000","last_became_active":"2024-04-26T07:28:31.178583+0000","last_became_peered":"2024-04-26T07:28:31.178583+0000","last_unstale":"2024-04-26T07:30:52.447536+0000","last_undegraded":"2024-04-26T07:30:52.447536+0000","last_fullsized":"2024-04-26T07:30:52.447536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:52.447536+0000","last_clean_scrub_stamp":"2024-04-26T07:30:52.447536+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:04.922994+0000","last_change":"2024-04-26T07:32:04.923102+0000","last_active":"2024-04-26T07:32:04.922994+0000","last_peered":"2024-04-26T07:32:04.922994+0000","last_clean":"2024-04-26T07:32:04.922994+0000","last_became_active":"2024-04-26T07:28:31.174061+0000","last_became_peered":"2024-04-26T07:28:31.174061+0000","last_unstale":"2024-04-26T07:32:04.922994+0000","last_undegraded":"2024-04-26T07:32:04.922994+0000","last_fullsized":"2024-04-26T07:32:04.922994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:04.922994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:04.922994+0000","last_clean_scrub_stamp":"2024-04-26T07:32:04.922994+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:54.059185+0000","last_change":"2024-04-26T07:30:54.059310+0000","last_active":"2024-04-26T07:30:54.059185+0000","last_peered":"2024-04-26T07:30:54.059185+0000","last_clean":"2024-04-26T07:30:54.059185+0000","last_became_active":"2024-04-26T07:28:31.158170+0000","last_became_peered":"2024-04-26T07:28:31.158170+0000","last_unstale":"2024-04-26T07:30:54.059185+0000","last_undegraded":"2024-04-26T07:30:54.059185+0000","last_fullsized":"2024-04-26T07:30:54.059185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:54.059185+0000","last_clean_scrub_stamp":"2024-04-26T07:30:54.059185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:53.020287+0000","last_change":"2024-04-26T07:30:53.020393+0000","last_active":"2024-04-26T07:30:53.020287+0000","last_peered":"2024-04-26T07:30:53.020287+0000","last_clean":"2024-04-26T07:30:53.020287+0000","last_became_active":"2024-04-26T07:28:31.159573+0000","last_became_peered":"2024-04-26T07:28:31.159573+0000","last_unstale":"2024-04-26T07:30:53.020287+0000","last_undegraded":"2024-04-26T07:30:53.020287+0000","last_fullsized":"2024-04-26T07:30:53.020287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:53.020286+0000","last_clean_scrub_stamp":"2024-04-26T07:30:53.020286+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.976317+0000","last_change":"2024-04-26T07:30:50.976414+0000","last_active":"2024-04-26T07:30:50.976317+0000","last_peered":"2024-04-26T07:30:50.976317+0000","last_clean":"2024-04-26T07:30:50.976317+0000","last_became_active":"2024-04-26T07:28:31.159240+0000","last_became_peered":"2024-04-26T07:28:31.159240+0000","last_unstale":"2024-04-26T07:30:50.976317+0000","last_undegraded":"2024-04-26T07:30:50.976317+0000","last_fullsized":"2024-04-26T07:30:50.976317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.976316+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.976316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:03.926941+0000","last_change":"2024-04-26T07:32:03.927039+0000","last_active":"2024-04-26T07:32:03.926941+0000","last_peered":"2024-04-26T07:32:03.926941+0000","last_clean":"2024-04-26T07:32:03.926941+0000","last_became_active":"2024-04-26T07:28:31.173985+0000","last_became_peered":"2024-04-26T07:28:31.173985+0000","last_unstale":"2024-04-26T07:32:03.926941+0000","last_undegraded":"2024-04-26T07:32:03.926941+0000","last_fullsized":"2024-04-26T07:32:03.926941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:03.926941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:03.926941+0000","last_clean_scrub_stamp":"2024-04-26T07:32:03.926941+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.890710+0000","last_change":"2024-04-26T07:30:23.890791+0000","last_active":"2024-04-26T07:30:23.890710+0000","last_peered":"2024-04-26T07:30:23.890710+0000","last_clean":"2024-04-26T07:30:23.890710+0000","last_became_active":"2024-04-26T07:28:30.838167+0000","last_became_peered":"2024-04-26T07:28:30.838167+0000","last_unstale":"2024-04-26T07:30:23.890710+0000","last_undegraded":"2024-04-26T07:30:23.890710+0000","last_fullsized":"2024-04-26T07:30:23.890710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:30:23.890710+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.890710+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:49.881843+0000","last_change":"2024-04-26T07:31:49.881917+0000","last_active":"2024-04-26T07:31:49.881843+0000","last_peered":"2024-04-26T07:31:49.881843+0000","last_clean":"2024-04-26T07:31:49.881843+0000","last_became_active":"2024-04-26T07:28:31.171447+0000","last_became_peered":"2024-04-26T07:28:31.171447+0000","last_unstale":"2024-04-26T07:31:49.881843+0000","last_undegraded":"2024-04-26T07:31:49.881843+0000","last_fullsized":"2024-04-26T07:31:49.881843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:49.881842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:49.881842+0000","last_clean_scrub_stamp":"2024-04-26T07:31:49.881842+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:22.844919+0000","last_change":"2024-04-26T07:30:22.845011+0000","last_active":"2024-04-26T07:30:22.844919+0000","last_peered":"2024-04-26T07:30:22.844919+0000","last_clean":"2024-04-26T07:30:22.844919+0000","last_became_active":"2024-04-26T07:28:30.844956+0000","last_became_peered":"2024-04-26T07:28:30.844956+0000","last_unstale":"2024-04-26T07:30:22.844919+0000","last_undegraded":"2024-04-26T07:30:22.844919+0000","last_fullsized":"2024-04-26T07:30:22.844919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:22.844919+0000","last_clean_scrub_stamp":"2024-04-26T07:30:22.844919+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.440808+0000","last_change":"2024-04-26T07:30:44.440891+0000","last_active":"2024-04-26T07:30:44.440808+0000","last_peered":"2024-04-26T07:30:44.440808+0000","last_clean":"2024-04-26T07:30:44.440808+0000","last_became_active":"2024-04-26T07:28:31.186197+0000","last_became_peered":"2024-04-26T07:28:31.186197+0000","last_unstale":"2024-04-26T07:30:44.440808+0000","last_undegraded":"2024-04-26T07:30:44.440808+0000","last_fullsized":"2024-04-26T07:30:44.440808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.440807+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.440807+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:08.046243+0000","last_change":"2024-04-26T07:31:08.046335+0000","last_active":"2024-04-26T07:31:08.046243+0000","last_peered":"2024-04-26T07:31:08.046243+0000","last_clean":"2024-04-26T07:31:08.046243+0000","last_became_active":"2024-04-26T07:28:30.850885+0000","last_became_peered":"2024-04-26T07:28:30.850885+0000","last_unstale":"2024-04-26T07:31:08.046243+0000","last_undegraded":"2024-04-26T07:31:08.046243+0000","last_fullsized":"2024-04-26T07:31:08.046243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:31:08.046243+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:31:08.046243+0000","last_clean_scrub_stamp":"2024-04-26T07:31:08.046243+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:53.901553+0000","last_change":"2024-04-26T07:31:53.901658+0000","last_active":"2024-04-26T07:31:53.901553+0000","last_peered":"2024-04-26T07:31:53.901553+0000","last_clean":"2024-04-26T07:31:53.901553+0000","last_became_active":"2024-04-26T07:28:31.171956+0000","last_became_peered":"2024-04-26T07:28:31.171956+0000","last_unstale":"2024-04-26T07:31:53.901553+0000","last_undegraded":"2024-04-26T07:31:53.901553+0000","last_fullsized":"2024-04-26T07:31:53.901553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:53.901552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:53.901552+0000","last_clean_scrub_stamp":"2024-04-26T07:31:53.901552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'9","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.580238+0000","last_change":"2024-04-26T07:30:25.580325+0000","last_active":"2024-04-26T07:30:25.580238+0000","last_peered":"2024-04-26T07:30:25.580238+0000","last_clean":"2024-04-26T07:30:25.580238+0000","last_became_active":"2024-04-26T07:28:30.849784+0000","last_became_peered":"2024-04-26T07:28:30.849784+0000","last_unstale":"2024-04-26T07:30:25.580238+0000","last_undegraded":"2024-04-26T07:30:25.580238+0000","last_fullsized":"2024-04-26T07:30:25.580238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'9","last_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_deep_scrub":"19'9","last_deep_scrub_stamp":"2024-04-26T07:30:25.580237+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.580237+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:37.906762+0000","last_change":"2024-04-26T07:31:37.906853+0000","last_active":"2024-04-26T07:31:37.906762+0000","last_peered":"2024-04-26T07:31:37.906762+0000","last_clean":"2024-04-26T07:31:37.906762+0000","last_became_active":"2024-04-26T07:28:31.159988+0000","last_became_peered":"2024-04-26T07:28:31.159988+0000","last_unstale":"2024-04-26T07:31:37.906762+0000","last_undegraded":"2024-04-26T07:31:37.906762+0000","last_fullsized":"2024-04-26T07:31:37.906762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:37.906761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:37.906761+0000","last_clean_scrub_stamp":"2024-04-26T07:31:37.906761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.163184+0000","last_change":"2024-04-26T07:30:15.163266+0000","last_active":"2024-04-26T07:30:15.163184+0000","last_peered":"2024-04-26T07:30:15.163184+0000","last_clean":"2024-04-26T07:30:15.163184+0000","last_became_active":"2024-04-26T07:28:30.851695+0000","last_became_peered":"2024-04-26T07:28:30.851695+0000","last_unstale":"2024-04-26T07:30:15.163184+0000","last_undegraded":"2024-04-26T07:30:15.163184+0000","last_fullsized":"2024-04-26T07:30:15.163184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:15.163183+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.163183+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:38.869746+0000","last_change":"2024-04-26T07:31:38.869839+0000","last_active":"2024-04-26T07:31:38.869746+0000","last_peered":"2024-04-26T07:31:38.869746+0000","last_clean":"2024-04-26T07:31:38.869746+0000","last_became_active":"2024-04-26T07:28:31.173243+0000","last_became_peered":"2024-04-26T07:28:31.173243+0000","last_unstale":"2024-04-26T07:31:38.869746+0000","last_undegraded":"2024-04-26T07:31:38.869746+0000","last_fullsized":"2024-04-26T07:31:38.869746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:38.869746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:38.869746+0000","last_clean_scrub_stamp":"2024-04-26T07:31:38.869746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:23.570415+0000","last_change":"2024-04-26T07:30:23.570499+0000","last_active":"2024-04-26T07:30:23.570415+0000","last_peered":"2024-04-26T07:30:23.570415+0000","last_clean":"2024-04-26T07:30:23.570415+0000","last_became_active":"2024-04-26T07:28:30.849439+0000","last_became_peered":"2024-04-26T07:28:30.849439+0000","last_unstale":"2024-04-26T07:30:23.570415+0000","last_undegraded":"2024-04-26T07:30:23.570415+0000","last_fullsized":"2024-04-26T07:30:23.570415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:30:23.570415+0000","last_clean_scrub_stamp":"2024-04-26T07:30:23.570415+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.011724+0000","last_change":"2024-04-26T07:30:44.011821+0000","last_active":"2024-04-26T07:30:44.011724+0000","last_peered":"2024-04-26T07:30:44.011724+0000","last_clean":"2024-04-26T07:30:44.011724+0000","last_became_active":"2024-04-26T07:28:31.159617+0000","last_became_peered":"2024-04-26T07:28:31.159617+0000","last_unstale":"2024-04-26T07:30:44.011724+0000","last_undegraded":"2024-04-26T07:30:44.011724+0000","last_fullsized":"2024-04-26T07:30:44.011724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.011723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.011723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'21","reported_seq":35,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:07.012832+0000","last_change":"2024-04-26T07:31:07.012911+0000","last_active":"2024-04-26T07:31:07.012832+0000","last_peered":"2024-04-26T07:31:07.012832+0000","last_clean":"2024-04-26T07:31:07.012832+0000","last_became_active":"2024-04-26T07:28:30.857177+0000","last_became_peered":"2024-04-26T07:28:30.857177+0000","last_unstale":"2024-04-26T07:31:07.012832+0000","last_undegraded":"2024-04-26T07:31:07.012832+0000","last_fullsized":"2024-04-26T07:31:07.012832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'21","last_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_deep_scrub":"19'21","last_deep_scrub_stamp":"2024-04-26T07:31:07.012831+0000","last_clean_scrub_stamp":"2024-04-26T07:31:07.012831+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.232011+0000","last_change":"2024-04-26T07:30:27.232105+0000","last_active":"2024-04-26T07:30:27.232011+0000","last_peered":"2024-04-26T07:30:27.232011+0000","last_clean":"2024-04-26T07:30:27.232011+0000","last_became_active":"2024-04-26T07:28:31.165007+0000","last_became_peered":"2024-04-26T07:28:31.165007+0000","last_unstale":"2024-04-26T07:30:27.232011+0000","last_undegraded":"2024-04-26T07:30:27.232011+0000","last_fullsized":"2024-04-26T07:30:27.232011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:27.232010+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.232010+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'7","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:01.928484+0000","last_change":"2024-04-26T07:31:01.928571+0000","last_active":"2024-04-26T07:31:01.928484+0000","last_peered":"2024-04-26T07:31:01.928484+0000","last_clean":"2024-04-26T07:31:01.928484+0000","last_became_active":"2024-04-26T07:28:30.852293+0000","last_became_peered":"2024-04-26T07:28:30.852293+0000","last_unstale":"2024-04-26T07:31:01.928484+0000","last_undegraded":"2024-04-26T07:31:01.928484+0000","last_fullsized":"2024-04-26T07:31:01.928484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'7","last_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_deep_scrub":"19'7","last_deep_scrub_stamp":"2024-04-26T07:31:01.928484+0000","last_clean_scrub_stamp":"2024-04-26T07:31:01.928484+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:43.892447+0000","last_change":"2024-04-26T07:31:43.892541+0000","last_active":"2024-04-26T07:31:43.892447+0000","last_peered":"2024-04-26T07:31:43.892447+0000","last_clean":"2024-04-26T07:31:43.892447+0000","last_became_active":"2024-04-26T07:28:31.158189+0000","last_became_peered":"2024-04-26T07:28:31.158189+0000","last_unstale":"2024-04-26T07:31:43.892447+0000","last_undegraded":"2024-04-26T07:31:43.892447+0000","last_fullsized":"2024-04-26T07:31:43.892447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:43.892447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:43.892447+0000","last_clean_scrub_stamp":"2024-04-26T07:31:43.892447+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:21.505390+0000","last_change":"2024-04-26T07:30:21.505470+0000","last_active":"2024-04-26T07:30:21.505390+0000","last_peered":"2024-04-26T07:30:21.505390+0000","last_clean":"2024-04-26T07:30:21.505390+0000","last_became_active":"2024-04-26T07:28:30.845637+0000","last_became_peered":"2024-04-26T07:28:30.845637+0000","last_unstale":"2024-04-26T07:30:21.505390+0000","last_undegraded":"2024-04-26T07:30:21.505390+0000","last_fullsized":"2024-04-26T07:30:21.505390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:21.505390+0000","last_clean_scrub_stamp":"2024-04-26T07:30:21.505390+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:45.872604+0000","last_change":"2024-04-26T07:31:45.872739+0000","last_active":"2024-04-26T07:31:45.872604+0000","last_peered":"2024-04-26T07:31:45.872604+0000","last_clean":"2024-04-26T07:31:45.872604+0000","last_became_active":"2024-04-26T07:28:31.174404+0000","last_became_peered":"2024-04-26T07:28:31.174404+0000","last_unstale":"2024-04-26T07:31:45.872604+0000","last_undegraded":"2024-04-26T07:31:45.872604+0000","last_fullsized":"2024-04-26T07:31:45.872604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:45.872603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:45.872603+0000","last_clean_scrub_stamp":"2024-04-26T07:31:45.872603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:56.845651+0000","last_change":"2024-04-26T07:30:56.845747+0000","last_active":"2024-04-26T07:30:56.845651+0000","last_peered":"2024-04-26T07:30:56.845651+0000","last_clean":"2024-04-26T07:30:56.845651+0000","last_became_active":"2024-04-26T07:28:30.859173+0000","last_became_peered":"2024-04-26T07:28:30.859173+0000","last_unstale":"2024-04-26T07:30:56.845651+0000","last_undegraded":"2024-04-26T07:30:56.845651+0000","last_fullsized":"2024-04-26T07:30:56.845651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:56.845650+0000","last_clean_scrub_stamp":"2024-04-26T07:30:56.845650+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.427936+0000","last_change":"2024-04-26T07:30:42.428022+0000","last_active":"2024-04-26T07:30:42.427936+0000","last_peered":"2024-04-26T07:30:42.427936+0000","last_clean":"2024-04-26T07:30:42.427936+0000","last_became_active":"2024-04-26T07:28:31.177660+0000","last_became_peered":"2024-04-26T07:28:31.177660+0000","last_unstale":"2024-04-26T07:30:42.427936+0000","last_undegraded":"2024-04-26T07:30:42.427936+0000","last_fullsized":"2024-04-26T07:30:42.427936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:42.427935+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.427935+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'15","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:18.834721+0000","last_change":"2024-04-26T07:30:18.834800+0000","last_active":"2024-04-26T07:30:18.834721+0000","last_peered":"2024-04-26T07:30:18.834721+0000","last_clean":"2024-04-26T07:30:18.834721+0000","last_became_active":"2024-04-26T07:28:30.837660+0000","last_became_peered":"2024-04-26T07:28:30.837660+0000","last_unstale":"2024-04-26T07:30:18.834721+0000","last_undegraded":"2024-04-26T07:30:18.834721+0000","last_fullsized":"2024-04-26T07:30:18.834721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'15","last_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_deep_scrub":"19'15","last_deep_scrub_stamp":"2024-04-26T07:30:18.834720+0000","last_clean_scrub_stamp":"2024-04-26T07:30:18.834720+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:47.891030+0000","last_change":"2024-04-26T07:31:47.891117+0000","last_active":"2024-04-26T07:31:47.891030+0000","last_peered":"2024-04-26T07:31:47.891030+0000","last_clean":"2024-04-26T07:31:47.891030+0000","last_became_active":"2024-04-26T07:28:31.172377+0000","last_became_peered":"2024-04-26T07:28:31.172377+0000","last_unstale":"2024-04-26T07:31:47.891030+0000","last_undegraded":"2024-04-26T07:31:47.891030+0000","last_fullsized":"2024-04-26T07:31:47.891030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:47.891030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:47.891030+0000","last_clean_scrub_stamp":"2024-04-26T07:31:47.891030+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.546240+0000","last_change":"2024-04-26T07:30:20.546354+0000","last_active":"2024-04-26T07:30:20.546240+0000","last_peered":"2024-04-26T07:30:20.546240+0000","last_clean":"2024-04-26T07:30:20.546240+0000","last_became_active":"2024-04-26T07:28:30.848998+0000","last_became_peered":"2024-04-26T07:28:30.848998+0000","last_unstale":"2024-04-26T07:30:20.546240+0000","last_undegraded":"2024-04-26T07:30:20.546240+0000","last_fullsized":"2024-04-26T07:30:20.546240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:20.546239+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.546239+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:30.819563+0000","last_change":"2024-04-26T07:31:30.819662+0000","last_active":"2024-04-26T07:31:30.819563+0000","last_peered":"2024-04-26T07:31:30.819563+0000","last_clean":"2024-04-26T07:31:30.819563+0000","last_became_active":"2024-04-26T07:28:31.160064+0000","last_became_peered":"2024-04-26T07:28:31.160064+0000","last_unstale":"2024-04-26T07:31:30.819563+0000","last_undegraded":"2024-04-26T07:31:30.819563+0000","last_fullsized":"2024-04-26T07:31:30.819563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:30.819563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:30.819563+0000","last_clean_scrub_stamp":"2024-04-26T07:31:30.819563+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:13.068833+0000","last_change":"2024-04-26T07:30:13.068913+0000","last_active":"2024-04-26T07:30:13.068833+0000","last_peered":"2024-04-26T07:30:13.068833+0000","last_clean":"2024-04-26T07:30:13.068833+0000","last_became_active":"2024-04-26T07:28:30.851276+0000","last_became_peered":"2024-04-26T07:28:30.851276+0000","last_unstale":"2024-04-26T07:30:13.068833+0000","last_undegraded":"2024-04-26T07:30:13.068833+0000","last_fullsized":"2024-04-26T07:30:13.068833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:13.068832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:13.068832+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.955449+0000","last_change":"2024-04-26T07:30:38.955557+0000","last_active":"2024-04-26T07:30:38.955449+0000","last_peered":"2024-04-26T07:30:38.955449+0000","last_clean":"2024-04-26T07:30:38.955449+0000","last_became_active":"2024-04-26T07:28:31.157253+0000","last_became_peered":"2024-04-26T07:28:31.157253+0000","last_unstale":"2024-04-26T07:30:38.955449+0000","last_undegraded":"2024-04-26T07:30:38.955449+0000","last_fullsized":"2024-04-26T07:30:38.955449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.955449+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.955449+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:51.700832+0000","last_change":"2024-04-26T07:30:51.700910+0000","last_active":"2024-04-26T07:30:51.700832+0000","last_peered":"2024-04-26T07:30:51.700832+0000","last_clean":"2024-04-26T07:30:51.700832+0000","last_became_active":"2024-04-26T07:28:30.853026+0000","last_became_peered":"2024-04-26T07:28:30.853026+0000","last_unstale":"2024-04-26T07:30:51.700832+0000","last_undegraded":"2024-04-26T07:30:51.700832+0000","last_fullsized":"2024-04-26T07:30:51.700832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:51.700832+0000","last_clean_scrub_stamp":"2024-04-26T07:30:51.700832+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.148236+0000","last_change":"2024-04-26T07:30:20.148325+0000","last_active":"2024-04-26T07:30:20.148236+0000","last_peered":"2024-04-26T07:30:20.148236+0000","last_clean":"2024-04-26T07:30:20.148236+0000","last_became_active":"2024-04-26T07:28:31.164385+0000","last_became_peered":"2024-04-26T07:28:31.164385+0000","last_unstale":"2024-04-26T07:30:20.148236+0000","last_undegraded":"2024-04-26T07:30:20.148236+0000","last_fullsized":"2024-04-26T07:30:20.148236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.148235+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.148235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.511807+0000","last_change":"2024-04-26T07:30:16.511900+0000","last_active":"2024-04-26T07:30:16.511807+0000","last_peered":"2024-04-26T07:30:16.511807+0000","last_clean":"2024-04-26T07:30:16.511807+0000","last_became_active":"2024-04-26T07:28:30.844621+0000","last_became_peered":"2024-04-26T07:28:30.844621+0000","last_unstale":"2024-04-26T07:30:16.511807+0000","last_undegraded":"2024-04-26T07:30:16.511807+0000","last_fullsized":"2024-04-26T07:30:16.511807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.511806+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.511806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:34.479850+0000","last_change":"2024-04-26T07:30:34.479942+0000","last_active":"2024-04-26T07:30:34.479850+0000","last_peered":"2024-04-26T07:30:34.479850+0000","last_clean":"2024-04-26T07:30:34.479850+0000","last_became_active":"2024-04-26T07:28:31.183725+0000","last_became_peered":"2024-04-26T07:28:31.183725+0000","last_unstale":"2024-04-26T07:30:34.479850+0000","last_undegraded":"2024-04-26T07:30:34.479850+0000","last_fullsized":"2024-04-26T07:30:34.479850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:34.479849+0000","last_clean_scrub_stamp":"2024-04-26T07:30:34.479849+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:49.675793+0000","last_change":"2024-04-26T07:30:49.675867+0000","last_active":"2024-04-26T07:30:49.675793+0000","last_peered":"2024-04-26T07:30:49.675793+0000","last_clean":"2024-04-26T07:30:49.675793+0000","last_became_active":"2024-04-26T07:28:30.852522+0000","last_became_peered":"2024-04-26T07:28:30.852522+0000","last_unstale":"2024-04-26T07:30:49.675793+0000","last_undegraded":"2024-04-26T07:30:49.675793+0000","last_fullsized":"2024-04-26T07:30:49.675793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:49.675793+0000","last_clean_scrub_stamp":"2024-04-26T07:30:49.675793+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:38.454434+0000","last_change":"2024-04-26T07:30:38.454554+0000","last_active":"2024-04-26T07:30:38.454434+0000","last_peered":"2024-04-26T07:30:38.454434+0000","last_clean":"2024-04-26T07:30:38.454434+0000","last_became_active":"2024-04-26T07:28:31.165194+0000","last_became_peered":"2024-04-26T07:28:31.165194+0000","last_unstale":"2024-04-26T07:30:38.454434+0000","last_undegraded":"2024-04-26T07:30:38.454434+0000","last_fullsized":"2024-04-26T07:30:38.454434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:38.454433+0000","last_clean_scrub_stamp":"2024-04-26T07:30:38.454433+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:42.698682+0000","last_change":"2024-04-26T07:30:42.698763+0000","last_active":"2024-04-26T07:30:42.698682+0000","last_peered":"2024-04-26T07:30:42.698682+0000","last_clean":"2024-04-26T07:30:42.698682+0000","last_became_active":"2024-04-26T07:28:30.846911+0000","last_became_peered":"2024-04-26T07:28:30.846911+0000","last_unstale":"2024-04-26T07:30:42.698682+0000","last_undegraded":"2024-04-26T07:30:42.698682+0000","last_fullsized":"2024-04-26T07:30:42.698682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:42.698682+0000","last_clean_scrub_stamp":"2024-04-26T07:30:42.698682+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:33.855842+0000","last_change":"2024-04-26T07:31:33.855936+0000","last_active":"2024-04-26T07:31:33.855842+0000","last_peered":"2024-04-26T07:31:33.855842+0000","last_clean":"2024-04-26T07:31:33.855842+0000","last_became_active":"2024-04-26T07:28:31.159342+0000","last_became_peered":"2024-04-26T07:28:31.159342+0000","last_unstale":"2024-04-26T07:31:33.855842+0000","last_undegraded":"2024-04-26T07:31:33.855842+0000","last_fullsized":"2024-04-26T07:31:33.855842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:33.855841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:33.855841+0000","last_clean_scrub_stamp":"2024-04-26T07:31:33.855841+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:35.647109+0000","last_change":"2024-04-26T07:30:35.647193+0000","last_active":"2024-04-26T07:30:35.647109+0000","last_peered":"2024-04-26T07:30:35.647109+0000","last_clean":"2024-04-26T07:30:35.647109+0000","last_became_active":"2024-04-26T07:28:30.858913+0000","last_became_peered":"2024-04-26T07:28:30.858913+0000","last_unstale":"2024-04-26T07:30:35.647109+0000","last_undegraded":"2024-04-26T07:30:35.647109+0000","last_fullsized":"2024-04-26T07:30:35.647109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:35.647108+0000","last_clean_scrub_stamp":"2024-04-26T07:30:35.647108+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:25.207071+0000","last_change":"2024-04-26T07:30:25.207160+0000","last_active":"2024-04-26T07:30:25.207071+0000","last_peered":"2024-04-26T07:30:25.207071+0000","last_clean":"2024-04-26T07:30:25.207071+0000","last_became_active":"2024-04-26T07:28:31.163769+0000","last_became_peered":"2024-04-26T07:28:31.163769+0000","last_unstale":"2024-04-26T07:30:25.207071+0000","last_undegraded":"2024-04-26T07:30:25.207071+0000","last_fullsized":"2024-04-26T07:30:25.207071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:25.207070+0000","last_clean_scrub_stamp":"2024-04-26T07:30:25.207070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.679673+0000","last_change":"2024-04-26T07:30:33.679748+0000","last_active":"2024-04-26T07:30:33.679673+0000","last_peered":"2024-04-26T07:30:33.679673+0000","last_clean":"2024-04-26T07:30:33.679673+0000","last_became_active":"2024-04-26T07:28:30.847391+0000","last_became_peered":"2024-04-26T07:28:30.847391+0000","last_unstale":"2024-04-26T07:30:33.679673+0000","last_undegraded":"2024-04-26T07:30:33.679673+0000","last_fullsized":"2024-04-26T07:30:33.679673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:33.679672+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.679672+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:43.016723+0000","last_change":"2024-04-26T07:30:43.016816+0000","last_active":"2024-04-26T07:30:43.016723+0000","last_peered":"2024-04-26T07:30:43.016723+0000","last_clean":"2024-04-26T07:30:43.016723+0000","last_became_active":"2024-04-26T07:28:31.159785+0000","last_became_peered":"2024-04-26T07:28:31.159785+0000","last_unstale":"2024-04-26T07:30:43.016723+0000","last_undegraded":"2024-04-26T07:30:43.016723+0000","last_fullsized":"2024-04-26T07:30:43.016723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:43.016723+0000","last_clean_scrub_stamp":"2024-04-26T07:30:43.016723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.867473+0000","last_change":"2024-04-26T07:30:09.867557+0000","last_active":"2024-04-26T07:30:09.867473+0000","last_peered":"2024-04-26T07:30:09.867473+0000","last_clean":"2024-04-26T07:30:09.867473+0000","last_became_active":"2024-04-26T07:28:22.649954+0000","last_became_peered":"2024-04-26T07:28:22.649954+0000","last_unstale":"2024-04-26T07:30:09.867473+0000","last_undegraded":"2024-04-26T07:30:09.867473+0000","last_fullsized":"2024-04-26T07:30:09.867473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:09.867473+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.867473+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.023356+0000","last_change":"2024-04-26T07:30:11.023477+0000","last_active":"2024-04-26T07:30:11.023356+0000","last_peered":"2024-04-26T07:30:11.023356+0000","last_clean":"2024-04-26T07:30:11.023356+0000","last_became_active":"2024-04-26T07:28:30.850837+0000","last_became_peered":"2024-04-26T07:28:30.850837+0000","last_unstale":"2024-04-26T07:30:11.023356+0000","last_undegraded":"2024-04-26T07:30:11.023356+0000","last_fullsized":"2024-04-26T07:30:11.023356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:11.023356+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.023356+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:30.811830+0000","last_change":"2024-04-26T07:30:30.811917+0000","last_active":"2024-04-26T07:30:30.811830+0000","last_peered":"2024-04-26T07:30:30.811830+0000","last_clean":"2024-04-26T07:30:30.811830+0000","last_became_active":"2024-04-26T07:28:31.159459+0000","last_became_peered":"2024-04-26T07:28:31.159459+0000","last_unstale":"2024-04-26T07:30:30.811830+0000","last_undegraded":"2024-04-26T07:30:30.811830+0000","last_fullsized":"2024-04-26T07:30:30.811830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:30.811830+0000","last_clean_scrub_stamp":"2024-04-26T07:30:30.811830+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:14.491026+0000","last_change":"2024-04-26T07:30:14.491123+0000","last_active":"2024-04-26T07:30:14.491026+0000","last_peered":"2024-04-26T07:30:14.491026+0000","last_clean":"2024-04-26T07:30:14.491026+0000","last_became_active":"2024-04-26T07:28:22.023120+0000","last_became_peered":"2024-04-26T07:28:22.023120+0000","last_unstale":"2024-04-26T07:30:14.491026+0000","last_undegraded":"2024-04-26T07:30:14.491026+0000","last_fullsized":"2024-04-26T07:30:14.491026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:14.491025+0000","last_clean_scrub_stamp":"2024-04-26T07:30:14.491025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'5","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:09.413359+0000","last_change":"2024-04-26T07:30:09.413441+0000","last_active":"2024-04-26T07:30:09.413359+0000","last_peered":"2024-04-26T07:30:09.413359+0000","last_clean":"2024-04-26T07:30:09.413359+0000","last_became_active":"2024-04-26T07:28:30.852967+0000","last_became_peered":"2024-04-26T07:28:30.852967+0000","last_unstale":"2024-04-26T07:30:09.413359+0000","last_undegraded":"2024-04-26T07:30:09.413359+0000","last_fullsized":"2024-04-26T07:30:09.413359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2024-04-26T07:30:09.413358+0000","last_clean_scrub_stamp":"2024-04-26T07:30:09.413358+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.849915+0000","last_change":"2024-04-26T07:30:31.850005+0000","last_active":"2024-04-26T07:30:31.849915+0000","last_peered":"2024-04-26T07:30:31.849915+0000","last_clean":"2024-04-26T07:30:31.849915+0000","last_became_active":"2024-04-26T07:28:31.154135+0000","last_became_peered":"2024-04-26T07:28:31.154135+0000","last_unstale":"2024-04-26T07:30:31.849915+0000","last_undegraded":"2024-04-26T07:30:31.849915+0000","last_fullsized":"2024-04-26T07:30:31.849915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.849914+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.849914+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.028509+0000","last_change":"2024-04-26T07:30:08.028621+0000","last_active":"2024-04-26T07:30:08.028509+0000","last_peered":"2024-04-26T07:30:08.028509+0000","last_clean":"2024-04-26T07:30:08.028509+0000","last_became_active":"2024-04-26T07:28:22.023502+0000","last_became_peered":"2024-04-26T07:28:22.023502+0000","last_unstale":"2024-04-26T07:30:08.028509+0000","last_undegraded":"2024-04-26T07:30:08.028509+0000","last_fullsized":"2024-04-26T07:30:08.028509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:08.028509+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.028509+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.809606+0000","last_change":"2024-04-26T07:30:12.809726+0000","last_active":"2024-04-26T07:30:12.809606+0000","last_peered":"2024-04-26T07:30:12.809606+0000","last_clean":"2024-04-26T07:30:12.809606+0000","last_became_active":"2024-04-26T07:28:30.839019+0000","last_became_peered":"2024-04-26T07:28:30.839019+0000","last_unstale":"2024-04-26T07:30:12.809606+0000","last_undegraded":"2024-04-26T07:30:12.809606+0000","last_fullsized":"2024-04-26T07:30:12.809606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:12.809605+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.809605+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.923160+0000","last_change":"2024-04-26T07:30:33.923250+0000","last_active":"2024-04-26T07:30:33.923160+0000","last_peered":"2024-04-26T07:30:33.923160+0000","last_clean":"2024-04-26T07:30:33.923160+0000","last_became_active":"2024-04-26T07:28:31.178655+0000","last_became_peered":"2024-04-26T07:28:31.178655+0000","last_unstale":"2024-04-26T07:30:33.923160+0000","last_undegraded":"2024-04-26T07:30:33.923160+0000","last_fullsized":"2024-04-26T07:30:33.923160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.923160+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.923160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:15.443421+0000","last_change":"2024-04-26T07:30:15.443501+0000","last_active":"2024-04-26T07:30:15.443421+0000","last_peered":"2024-04-26T07:30:15.443421+0000","last_clean":"2024-04-26T07:30:15.443421+0000","last_became_active":"2024-04-26T07:28:22.023456+0000","last_became_peered":"2024-04-26T07:28:22.023456+0000","last_unstale":"2024-04-26T07:30:15.443421+0000","last_undegraded":"2024-04-26T07:30:15.443421+0000","last_fullsized":"2024-04-26T07:30:15.443421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:15.443421+0000","last_clean_scrub_stamp":"2024-04-26T07:30:15.443421+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.891685+0000","last_change":"2024-04-26T07:30:08.891750+0000","last_active":"2024-04-26T07:30:08.891685+0000","last_peered":"2024-04-26T07:30:08.891685+0000","last_clean":"2024-04-26T07:30:08.891685+0000","last_became_active":"2024-04-26T07:28:18.549117+0000","last_became_peered":"2024-04-26T07:28:18.549117+0000","last_unstale":"2024-04-26T07:30:08.891685+0000","last_undegraded":"2024-04-26T07:30:08.891685+0000","last_fullsized":"2024-04-26T07:30:08.891685+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-04-26T07:30:08.891685+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.891685+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:20.436730+0000","last_change":"2024-04-26T07:30:20.436817+0000","last_active":"2024-04-26T07:30:20.436730+0000","last_peered":"2024-04-26T07:30:20.436730+0000","last_clean":"2024-04-26T07:30:20.436730+0000","last_became_active":"2024-04-26T07:28:30.858874+0000","last_became_peered":"2024-04-26T07:28:30.858874+0000","last_unstale":"2024-04-26T07:30:20.436730+0000","last_undegraded":"2024-04-26T07:30:20.436730+0000","last_fullsized":"2024-04-26T07:30:20.436730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:20.436730+0000","last_clean_scrub_stamp":"2024-04-26T07:30:20.436730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:29.840859+0000","last_change":"2024-04-26T07:31:29.840933+0000","last_active":"2024-04-26T07:31:29.840859+0000","last_peered":"2024-04-26T07:31:29.840859+0000","last_clean":"2024-04-26T07:31:29.840859+0000","last_became_active":"2024-04-26T07:28:31.171018+0000","last_became_peered":"2024-04-26T07:28:31.171018+0000","last_unstale":"2024-04-26T07:31:29.840859+0000","last_undegraded":"2024-04-26T07:31:29.840859+0000","last_fullsized":"2024-04-26T07:31:29.840859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:29.840858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:29.840858+0000","last_clean_scrub_stamp":"2024-04-26T07:31:29.840858+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:12.493074+0000","last_change":"2024-04-26T07:30:12.493165+0000","last_active":"2024-04-26T07:30:12.493074+0000","last_peered":"2024-04-26T07:30:12.493074+0000","last_clean":"2024-04-26T07:30:12.493074+0000","last_became_active":"2024-04-26T07:28:22.025940+0000","last_became_peered":"2024-04-26T07:28:22.025940+0000","last_unstale":"2024-04-26T07:30:12.493074+0000","last_undegraded":"2024-04-26T07:30:12.493074+0000","last_fullsized":"2024-04-26T07:30:12.493074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:12.493074+0000","last_clean_scrub_stamp":"2024-04-26T07:30:12.493074+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:08.440210+0000","last_change":"2024-04-26T07:30:08.440323+0000","last_active":"2024-04-26T07:30:08.440210+0000","last_peered":"2024-04-26T07:30:08.440210+0000","last_clean":"2024-04-26T07:30:08.440210+0000","last_became_active":"2024-04-26T07:28:30.854608+0000","last_became_peered":"2024-04-26T07:28:30.854608+0000","last_unstale":"2024-04-26T07:30:08.440210+0000","last_undegraded":"2024-04-26T07:30:08.440210+0000","last_fullsized":"2024-04-26T07:30:08.440210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-04-26T07:30:08.440209+0000","last_clean_scrub_stamp":"2024-04-26T07:30:08.440209+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:33.503368+0000","last_change":"2024-04-26T07:30:33.503463+0000","last_active":"2024-04-26T07:30:33.503368+0000","last_peered":"2024-04-26T07:30:33.503368+0000","last_clean":"2024-04-26T07:30:33.503368+0000","last_became_active":"2024-04-26T07:28:31.183841+0000","last_became_peered":"2024-04-26T07:28:31.183841+0000","last_unstale":"2024-04-26T07:30:33.503368+0000","last_undegraded":"2024-04-26T07:30:33.503368+0000","last_fullsized":"2024-04-26T07:30:33.503368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:33.503367+0000","last_clean_scrub_stamp":"2024-04-26T07:30:33.503367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.416586+0000","last_change":"2024-04-26T07:30:16.416716+0000","last_active":"2024-04-26T07:30:16.416586+0000","last_peered":"2024-04-26T07:30:16.416586+0000","last_clean":"2024-04-26T07:30:16.416586+0000","last_became_active":"2024-04-26T07:28:22.649978+0000","last_became_peered":"2024-04-26T07:28:22.649978+0000","last_unstale":"2024-04-26T07:30:16.416586+0000","last_undegraded":"2024-04-26T07:30:16.416586+0000","last_fullsized":"2024-04-26T07:30:16.416586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.416585+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.416585+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:16.810615+0000","last_change":"2024-04-26T07:30:16.810700+0000","last_active":"2024-04-26T07:30:16.810615+0000","last_peered":"2024-04-26T07:30:16.810615+0000","last_clean":"2024-04-26T07:30:16.810615+0000","last_became_active":"2024-04-26T07:28:30.843313+0000","last_became_peered":"2024-04-26T07:28:30.843313+0000","last_unstale":"2024-04-26T07:30:16.810615+0000","last_undegraded":"2024-04-26T07:30:16.810615+0000","last_fullsized":"2024-04-26T07:30:16.810615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:16.810615+0000","last_clean_scrub_stamp":"2024-04-26T07:30:16.810615+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.538993+0000","last_change":"2024-04-26T07:30:32.539075+0000","last_active":"2024-04-26T07:30:32.538993+0000","last_peered":"2024-04-26T07:30:32.538993+0000","last_clean":"2024-04-26T07:30:32.538993+0000","last_became_active":"2024-04-26T07:28:31.175663+0000","last_became_peered":"2024-04-26T07:28:31.175663+0000","last_unstale":"2024-04-26T07:30:32.538993+0000","last_undegraded":"2024-04-26T07:30:32.538993+0000","last_fullsized":"2024-04-26T07:30:32.538993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.538992+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.538992+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:28.602216+0000","last_change":"2024-04-26T07:30:28.602296+0000","last_active":"2024-04-26T07:30:28.602216+0000","last_peered":"2024-04-26T07:30:28.602216+0000","last_clean":"2024-04-26T07:30:28.602216+0000","last_became_active":"2024-04-26T07:28:30.854394+0000","last_became_peered":"2024-04-26T07:28:30.854394+0000","last_unstale":"2024-04-26T07:30:28.602216+0000","last_undegraded":"2024-04-26T07:30:28.602216+0000","last_fullsized":"2024-04-26T07:30:28.602216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:28.602216+0000","last_clean_scrub_stamp":"2024-04-26T07:30:28.602216+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.818279+0000","last_change":"2024-04-26T07:30:11.818359+0000","last_active":"2024-04-26T07:30:11.818279+0000","last_peered":"2024-04-26T07:30:11.818279+0000","last_clean":"2024-04-26T07:30:11.818279+0000","last_became_active":"2024-04-26T07:28:22.650005+0000","last_became_peered":"2024-04-26T07:28:22.650005+0000","last_unstale":"2024-04-26T07:30:11.818279+0000","last_undegraded":"2024-04-26T07:30:11.818279+0000","last_fullsized":"2024-04-26T07:30:11.818279+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:11.818278+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.818278+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:28.829091+0000","last_change":"2024-04-26T07:31:28.829177+0000","last_active":"2024-04-26T07:31:28.829091+0000","last_peered":"2024-04-26T07:31:28.829091+0000","last_clean":"2024-04-26T07:31:28.829091+0000","last_became_active":"2024-04-26T07:28:31.162208+0000","last_became_peered":"2024-04-26T07:28:31.162208+0000","last_unstale":"2024-04-26T07:31:28.829091+0000","last_undegraded":"2024-04-26T07:31:28.829091+0000","last_fullsized":"2024-04-26T07:31:28.829091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:28.829091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:28.829091+0000","last_clean_scrub_stamp":"2024-04-26T07:31:28.829091+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:17.377065+0000","last_change":"2024-04-26T07:30:17.377162+0000","last_active":"2024-04-26T07:30:17.377065+0000","last_peered":"2024-04-26T07:30:17.377065+0000","last_clean":"2024-04-26T07:30:17.377065+0000","last_became_active":"2024-04-26T07:28:22.649921+0000","last_became_peered":"2024-04-26T07:28:22.649921+0000","last_unstale":"2024-04-26T07:30:17.377065+0000","last_undegraded":"2024-04-26T07:30:17.377065+0000","last_fullsized":"2024-04-26T07:30:17.377065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:17.377064+0000","last_clean_scrub_stamp":"2024-04-26T07:30:17.377064+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:11.414289+0000","last_change":"2024-04-26T07:30:11.414367+0000","last_active":"2024-04-26T07:30:11.414289+0000","last_peered":"2024-04-26T07:30:11.414289+0000","last_clean":"2024-04-26T07:30:11.414289+0000","last_became_active":"2024-04-26T07:28:30.847228+0000","last_became_peered":"2024-04-26T07:28:30.847228+0000","last_unstale":"2024-04-26T07:30:11.414289+0000","last_undegraded":"2024-04-26T07:30:11.414289+0000","last_fullsized":"2024-04-26T07:30:11.414289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2024-04-26T07:30:11.414288+0000","last_clean_scrub_stamp":"2024-04-26T07:30:11.414288+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:19.136227+0000","last_change":"2024-04-26T07:30:19.136319+0000","last_active":"2024-04-26T07:30:19.136227+0000","last_peered":"2024-04-26T07:30:19.136227+0000","last_clean":"2024-04-26T07:30:19.136227+0000","last_became_active":"2024-04-26T07:28:31.160675+0000","last_became_peered":"2024-04-26T07:28:31.160675+0000","last_unstale":"2024-04-26T07:30:19.136227+0000","last_undegraded":"2024-04-26T07:30:19.136227+0000","last_fullsized":"2024-04-26T07:30:19.136227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:19.136226+0000","last_clean_scrub_stamp":"2024-04-26T07:30:19.136226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'12","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:29.574126+0000","last_change":"2024-04-26T07:30:29.574207+0000","last_active":"2024-04-26T07:30:29.574126+0000","last_peered":"2024-04-26T07:30:29.574126+0000","last_clean":"2024-04-26T07:30:29.574126+0000","last_became_active":"2024-04-26T07:28:30.845634+0000","last_became_peered":"2024-04-26T07:28:30.845634+0000","last_unstale":"2024-04-26T07:30:29.574126+0000","last_undegraded":"2024-04-26T07:30:29.574126+0000","last_fullsized":"2024-04-26T07:30:29.574126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2024-04-26T07:30:29.574125+0000","last_clean_scrub_stamp":"2024-04-26T07:30:29.574125+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:39.295620+0000","last_change":"2024-04-26T07:30:39.295711+0000","last_active":"2024-04-26T07:30:39.295620+0000","last_peered":"2024-04-26T07:30:39.295620+0000","last_clean":"2024-04-26T07:30:39.295620+0000","last_became_active":"2024-04-26T07:28:31.156107+0000","last_became_peered":"2024-04-26T07:28:31.156107+0000","last_unstale":"2024-04-26T07:30:39.295620+0000","last_undegraded":"2024-04-26T07:30:39.295620+0000","last_fullsized":"2024-04-26T07:30:39.295620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:39.295619+0000","last_clean_scrub_stamp":"2024-04-26T07:30:39.295619+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:27.788374+0000","last_change":"2024-04-26T07:30:27.788453+0000","last_active":"2024-04-26T07:30:27.788374+0000","last_peered":"2024-04-26T07:30:27.788374+0000","last_clean":"2024-04-26T07:30:27.788374+0000","last_became_active":"2024-04-26T07:28:30.852368+0000","last_became_peered":"2024-04-26T07:28:30.852368+0000","last_unstale":"2024-04-26T07:30:27.788374+0000","last_undegraded":"2024-04-26T07:30:27.788374+0000","last_fullsized":"2024-04-26T07:30:27.788374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:30:27.788374+0000","last_clean_scrub_stamp":"2024-04-26T07:30:27.788374+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:36.226727+0000","last_change":"2024-04-26T07:30:36.226816+0000","last_active":"2024-04-26T07:30:36.226727+0000","last_peered":"2024-04-26T07:30:36.226727+0000","last_clean":"2024-04-26T07:30:36.226727+0000","last_became_active":"2024-04-26T07:28:31.165441+0000","last_became_peered":"2024-04-26T07:28:31.165441+0000","last_unstale":"2024-04-26T07:30:36.226727+0000","last_undegraded":"2024-04-26T07:30:36.226727+0000","last_fullsized":"2024-04-26T07:30:36.226727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:36.226726+0000","last_clean_scrub_stamp":"2024-04-26T07:30:36.226726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:11.969596+0000","last_change":"2024-04-26T07:31:11.969715+0000","last_active":"2024-04-26T07:31:11.969596+0000","last_peered":"2024-04-26T07:31:11.969596+0000","last_clean":"2024-04-26T07:31:11.969596+0000","last_became_active":"2024-04-26T07:28:30.852364+0000","last_became_peered":"2024-04-26T07:28:30.852364+0000","last_unstale":"2024-04-26T07:31:11.969596+0000","last_undegraded":"2024-04-26T07:31:11.969596+0000","last_fullsized":"2024-04-26T07:31:11.969596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-26T07:31:11.969596+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-26T07:31:11.969596+0000","last_clean_scrub_stamp":"2024-04-26T07:31:11.969596+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:32.249230+0000","last_change":"2024-04-26T07:30:32.249320+0000","last_active":"2024-04-26T07:30:32.249230+0000","last_peered":"2024-04-26T07:30:32.249230+0000","last_clean":"2024-04-26T07:30:32.249230+0000","last_became_active":"2024-04-26T07:28:31.164750+0000","last_became_peered":"2024-04-26T07:28:31.164750+0000","last_unstale":"2024-04-26T07:30:32.249230+0000","last_undegraded":"2024-04-26T07:30:32.249230+0000","last_fullsized":"2024-04-26T07:30:32.249230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:32.249230+0000","last_clean_scrub_stamp":"2024-04-26T07:30:32.249230+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:18.959835+0000","last_change":"2024-04-26T07:31:18.959927+0000","last_active":"2024-04-26T07:31:18.959835+0000","last_peered":"2024-04-26T07:31:18.959835+0000","last_clean":"2024-04-26T07:31:18.959835+0000","last_became_active":"2024-04-26T07:28:30.858043+0000","last_became_peered":"2024-04-26T07:28:30.858043+0000","last_unstale":"2024-04-26T07:31:18.959835+0000","last_undegraded":"2024-04-26T07:31:18.959835+0000","last_fullsized":"2024-04-26T07:31:18.959835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2024-04-26T07:31:18.959834+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2024-04-26T07:31:18.959834+0000","last_clean_scrub_stamp":"2024-04-26T07:31:18.959834+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:48.895395+0000","last_change":"2024-04-26T07:31:48.895491+0000","last_active":"2024-04-26T07:31:48.895395+0000","last_peered":"2024-04-26T07:31:48.895395+0000","last_clean":"2024-04-26T07:31:48.895395+0000","last_became_active":"2024-04-26T07:28:31.154775+0000","last_became_peered":"2024-04-26T07:28:31.154775+0000","last_unstale":"2024-04-26T07:31:48.895395+0000","last_undegraded":"2024-04-26T07:31:48.895395+0000","last_fullsized":"2024-04-26T07:31:48.895395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:48.895394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:48.895394+0000","last_clean_scrub_stamp":"2024-04-26T07:31:48.895394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.561764+0000","last_change":"2024-04-26T07:30:31.561845+0000","last_active":"2024-04-26T07:30:31.561764+0000","last_peered":"2024-04-26T07:30:31.561764+0000","last_clean":"2024-04-26T07:30:31.561764+0000","last_became_active":"2024-04-26T07:28:30.847404+0000","last_became_peered":"2024-04-26T07:28:30.847404+0000","last_unstale":"2024-04-26T07:30:31.561764+0000","last_undegraded":"2024-04-26T07:30:31.561764+0000","last_fullsized":"2024-04-26T07:30:31.561764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-26T07:30:31.561764+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.561764+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:31.216511+0000","last_change":"2024-04-26T07:30:31.216609+0000","last_active":"2024-04-26T07:30:31.216511+0000","last_peered":"2024-04-26T07:30:31.216511+0000","last_clean":"2024-04-26T07:30:31.216511+0000","last_became_active":"2024-04-26T07:28:31.163643+0000","last_became_peered":"2024-04-26T07:28:31.163643+0000","last_unstale":"2024-04-26T07:30:31.216511+0000","last_undegraded":"2024-04-26T07:30:31.216511+0000","last_fullsized":"2024-04-26T07:30:31.216511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:31.216510+0000","last_clean_scrub_stamp":"2024-04-26T07:30:31.216510+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:44.967952+0000","last_change":"2024-04-26T07:30:44.968081+0000","last_active":"2024-04-26T07:30:44.967952+0000","last_peered":"2024-04-26T07:30:44.967952+0000","last_clean":"2024-04-26T07:30:44.967952+0000","last_became_active":"2024-04-26T07:28:31.158775+0000","last_became_peered":"2024-04-26T07:28:31.158775+0000","last_unstale":"2024-04-26T07:30:44.967952+0000","last_undegraded":"2024-04-26T07:30:44.967952+0000","last_fullsized":"2024-04-26T07:30:44.967952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:44.967951+0000","last_clean_scrub_stamp":"2024-04-26T07:30:44.967951+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:31:56.957441+0000","last_change":"2024-04-26T07:31:56.957535+0000","last_active":"2024-04-26T07:31:56.957441+0000","last_peered":"2024-04-26T07:31:56.957441+0000","last_clean":"2024-04-26T07:31:56.957441+0000","last_became_active":"2024-04-26T07:28:31.154187+0000","last_became_peered":"2024-04-26T07:28:31.154187+0000","last_unstale":"2024-04-26T07:31:56.957441+0000","last_undegraded":"2024-04-26T07:31:56.957441+0000","last_fullsized":"2024-04-26T07:31:56.957441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:31:56.957441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:31:56.957441+0000","last_clean_scrub_stamp":"2024-04-26T07:31:56.957441+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:50.450558+0000","last_change":"2024-04-26T07:30:50.450657+0000","last_active":"2024-04-26T07:30:50.450558+0000","last_peered":"2024-04-26T07:30:50.450558+0000","last_clean":"2024-04-26T07:30:50.450558+0000","last_became_active":"2024-04-26T07:28:31.165196+0000","last_became_peered":"2024-04-26T07:28:31.165196+0000","last_unstale":"2024-04-26T07:30:50.450558+0000","last_undegraded":"2024-04-26T07:30:50.450558+0000","last_fullsized":"2024-04-26T07:30:50.450558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:50.450557+0000","last_clean_scrub_stamp":"2024-04-26T07:30:50.450557+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:32:02.940556+0000","last_change":"2024-04-26T07:32:02.940658+0000","last_active":"2024-04-26T07:32:02.940556+0000","last_peered":"2024-04-26T07:32:02.940556+0000","last_clean":"2024-04-26T07:32:02.940556+0000","last_became_active":"2024-04-26T07:28:31.155357+0000","last_became_peered":"2024-04-26T07:28:31.155357+0000","last_unstale":"2024-04-26T07:32:02.940556+0000","last_undegraded":"2024-04-26T07:32:02.940556+0000","last_fullsized":"2024-04-26T07:32:02.940556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:32:02.940555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:32:02.940555+0000","last_clean_scrub_stamp":"2024-04-26T07:32:02.940555+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T07:30:46.936609+0000","last_change":"2024-04-26T07:30:46.936704+0000","last_active":"2024-04-26T07:30:46.936609+0000","last_peered":"2024-04-26T07:30:46.936609+0000","last_clean":"2024-04-26T07:30:46.936609+0000","last_became_active":"2024-04-26T07:28:31.161974+0000","last_became_peered":"2024-04-26T07:28:31.161974+0000","last_unstale":"2024-04-26T07:30:46.936609+0000","last_undegraded":"2024-04-26T07:30:46.936609+0000","last_fullsized":"2024-04-26T07:30:46.936609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:30:46.936608+0000","last_clean_scrub_stamp":"2024-04-26T07:30:46.936608+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7997,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":15994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4116,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705716,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":62136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.27300000000000002},"min":{"1min":0.22500000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.40500000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.308,"15min":0.30099999999999999},"min":{"1min":0.246,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.42999999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Apr 26 07:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.311},"min":{"1min":0.27900000000000003,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.46000000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.317,"15min":0.308},"min":{"1min":0.27500000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.46899999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Apr 26 07:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.34699999999999998,"15min":0.33700000000000002},"min":{"1min":0.28699999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.44800000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.378},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.32400000000000001,"15min":0.316},"min":{"1min":0.26600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.44800000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.42599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.28999999999999998,"15min":0.28699999999999998},"min":{"1min":0.222,"5min":0.16,"15min":0.16},"max":{"1min":0.41999999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.308},"min":{"1min":0.22800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.432,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Apr 26 07:31:26 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.498,"5min":0.503,"15min":0.503},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.53400000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 07:32:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.30599999999999999,"15min":0.27900000000000003},"min":{"1min":0.183,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.46700000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.307},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.31900000000000001,"15min":0.29699999999999999},"min":{"1min":0.28299999999999997,"5min":0.192,"15min":0.192},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.28299999999999997}]},{"osd":2,"last update":"Fri Apr 26 07:32:26 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.33700000000000002,"15min":0.31900000000000001},"min":{"1min":0.23400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.34200000000000003,"15min":0.31900000000000001},"min":{"1min":0.26900000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.26900000000000002}]},{"osd":3,"last update":"Fri Apr 26 07:32:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.35199999999999998,"15min":0.32400000000000001},"min":{"1min":0.253,"5min":0.224,"15min":0.224},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.32000000000000001},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.25}]}]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 07:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.311,"15min":0.30199999999999999},"min":{"1min":0.24299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.443,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33900000000000002,"15min":0.32300000000000001},"min":{"1min":0.222,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Apr 26 07:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.33900000000000002},"min":{"1min":0.252,"5min":0.193,"15min":0.193},"max":{"1min":0.50800000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.435},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Apr 26 07:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36299999999999999,"15min":0.35299999999999998},"min":{"1min":0.26300000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.34699999999999998},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54700000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.376}]}]}]}} 2024-04-26T07:32:30.565 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T07:32:30.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.702+0000 7ff790c37700 1 Processor -- start 2024-04-26T07:32:30.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.702+0000 7ff790c37700 1 -- start start 2024-04-26T07:32:30.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff790c37700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff78c0a3170 0x7ff78c09e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff790c37700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c09c9e0 0x7ff78c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff790c37700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c09f420 0x7ff78c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff790c37700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c09e2a0 con 0x7ff78c0a3170 2024-04-26T07:32:30.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff790c37700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c09ce70 con 0x7ff78c09c9e0 2024-04-26T07:32:30.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff790c37700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c09d110 con 0x7ff78c09f420 2024-04-26T07:32:30.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff789d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c09c9e0 0x7ff78c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff78ad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c09f420 0x7ff78c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff78a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff78c0a3170 0x7ff78c09e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff789d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c09c9e0 0x7ff78c0a3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53724/0 (socket says 172.21.15.31:53724) 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.703+0000 7ff789d9b700 1 -- 172.21.15.31:0/3987356889 learned_addr learned my addr 172.21.15.31:0/3987356889 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff789d9b700 1 -- 172.21.15.31:0/3987356889 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c09f420 msgr2=0x7ff78c0a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff789d9b700 1 --2- 172.21.15.31:0/3987356889 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c09f420 0x7ff78c0a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff789d9b700 1 -- 172.21.15.31:0/3987356889 >> v2:172.21.15.31:3300/0 conn(0x7ff78c0a3170 msgr2=0x7ff78c09e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff789d9b700 1 --2- 172.21.15.31:0/3987356889 >> v2:172.21.15.31:3300/0 conn(0x7ff78c0a3170 0x7ff78c09e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff789d9b700 1 -- 172.21.15.31:0/3987356889 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c0a3f30 con 0x7ff78c09c9e0 2024-04-26T07:32:30.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff78a59c700 1 --2- 172.21.15.31:0/3987356889 >> v2:172.21.15.31:3300/0 conn(0x7ff78c0a3170 0x7ff78c09e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:30.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff78ad9d700 1 --2- 172.21.15.31:0/3987356889 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c09f420 0x7ff78c0a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:30.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff789d9b700 1 --2- 172.21.15.31:0/3987356889 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c09c9e0 0x7ff78c0a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff77c002f70 tx=0x7ff77c006e40).ready entity=mon.1 client_cookie=d54222d47cf43a2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:30.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff78959a700 1 -- 172.21.15.31:0/3987356889 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77c00bb90 con 0x7ff78c09c9e0 2024-04-26T07:32:30.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff78959a700 1 -- 172.21.15.31:0/3987356889 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c000e90 con 0x7ff78c09c9e0 2024-04-26T07:32:30.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff78959a700 1 -- 172.21.15.31:0/3987356889 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77c0153f0 con 0x7ff78c09c9e0 2024-04-26T07:32:30.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff790c37700 1 -- 172.21.15.31:0/3987356889 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c09c9e0 msgr2=0x7ff78c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.704+0000 7ff790c37700 1 --2- 172.21.15.31:0/3987356889 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c09c9e0 0x7ff78c0a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff77c002f70 tx=0x7ff77c006e40).stop 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.705+0000 7ff790c37700 1 -- 172.21.15.31:0/3987356889 shutdown_connections 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.705+0000 7ff790c37700 1 --2- 172.21.15.31:0/3987356889 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c09f420 0x7ff78c0a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.705+0000 7ff790c37700 1 --2- 172.21.15.31:0/3987356889 >> v2:172.21.15.31:3300/0 conn(0x7ff78c0a3170 0x7ff78c09e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.705+0000 7ff790c37700 1 --2- 172.21.15.31:0/3987356889 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c09c9e0 0x7ff78c0a3550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.705+0000 7ff790c37700 1 -- 172.21.15.31:0/3987356889 >> 172.21.15.31:0/3987356889 conn(0x7ff78c060ee0 msgr2=0x7ff78c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.705+0000 7ff790c37700 1 -- 172.21.15.31:0/3987356889 shutdown_connections 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.705+0000 7ff790c37700 1 -- 172.21.15.31:0/3987356889 wait complete. 2024-04-26T07:32:30.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.706+0000 7ff790c37700 1 Processor -- start 2024-04-26T07:32:30.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.706+0000 7ff790c37700 1 -- start start 2024-04-26T07:32:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.706+0000 7ff790c37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff78c09f420 0x7ff78c093f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.706+0000 7ff790c37700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c0a3170 0x7ff78c1459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.706+0000 7ff790c37700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c0673e0 0x7ff78c145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff790c37700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c092950 con 0x7ff78c09f420 2024-04-26T07:32:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff790c37700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1463c0 con 0x7ff78c0673e0 2024-04-26T07:32:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff790c37700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0945f0 con 0x7ff78c0a3170 2024-04-26T07:32:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff78c09f420 0x7ff78c093f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff78c09f420 0x7ff78c093f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59236/0 (socket says 172.21.15.31:59236) 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78a59c700 1 -- 172.21.15.31:0/661896761 learned_addr learned my addr 172.21.15.31:0/661896761 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78ad9d700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c0673e0 0x7ff78c145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff789d9b700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c0a3170 0x7ff78c1459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78ad9d700 1 -- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c0a3170 msgr2=0x7ff78c1459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78ad9d700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c0a3170 0x7ff78c1459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78ad9d700 1 -- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff78c09f420 msgr2=0x7ff78c093f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78ad9d700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff78c09f420 0x7ff78c093f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78ad9d700 1 -- 172.21.15.31:0/661896761 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff784009470 con 0x7ff78c0673e0 2024-04-26T07:32:30.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78a59c700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff78c09f420 0x7ff78c093f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:30.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff789d9b700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c0a3170 0x7ff78c1459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:30.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff78ad9d700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c0673e0 0x7ff78c145ed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff78400c000 tx=0x7ff7840091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:30.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff7837fe700 1 -- 172.21.15.31:0/661896761 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff78400c670 con 0x7ff78c0673e0 2024-04-26T07:32:30.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff7837fe700 1 -- 172.21.15.31:0/661896761 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78400c7d0 con 0x7ff78c0673e0 2024-04-26T07:32:30.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77400b180 con 0x7ff78c0673e0 2024-04-26T07:32:30.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff7837fe700 1 -- 172.21.15.31:0/661896761 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff78400cb30 con 0x7ff78c0673e0 2024-04-26T07:32:30.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.707+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c00d4d0 con 0x7ff78c0673e0 2024-04-26T07:32:30.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.708+0000 7ff7837fe700 1 -- 172.21.15.31:0/661896761 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff784022070 con 0x7ff78c0673e0 2024-04-26T07:32:30.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.708+0000 7ff7837fe700 1 -- 172.21.15.31:0/661896761 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff78404b0a0 con 0x7ff78c0673e0 2024-04-26T07:32:30.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.708+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c092de0 con 0x7ff78c0673e0 2024-04-26T07:32:30.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.712+0000 7ff7837fe700 1 -- 172.21.15.31:0/661896761 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff7840338c0 con 0x7ff78c0673e0 2024-04-26T07:32:30.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.828+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff78c05c4e0 con 0x7ff78c0673e0 2024-04-26T07:32:30.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.834+0000 7ff7837fe700 1 -- 172.21.15.31:0/661896761 <== mon.1 v2:172.21.15.31:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff7840338c0 con 0x7ff78c0673e0 2024-04-26T07:32:30.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.834+0000 7ff7837fe700 1 -- 172.21.15.31:0/661896761 <== mon.1 v2:172.21.15.31:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff784029030 con 0x7ff78c0673e0 2024-04-26T07:32:30.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.836+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 >> v1:172.21.15.31:6816/39613 conn(0x7ff770038da0 legacy=0x7ff77003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.836+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c0673e0 msgr2=0x7ff78c145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.836+0000 7ff790c37700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c0673e0 0x7ff78c145ed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff78400c000 tx=0x7ff7840091d0).stop 2024-04-26T07:32:30.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.837+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 shutdown_connections 2024-04-26T07:32:30.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.837+0000 7ff790c37700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff78c0673e0 0x7ff78c145ed0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.837+0000 7ff790c37700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff78c09f420 0x7ff78c093f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.837+0000 7ff790c37700 1 --2- 172.21.15.31:0/661896761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff78c0a3170 0x7ff78c1459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.837+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 >> 172.21.15.31:0/661896761 conn(0x7ff78c060ee0 msgr2=0x7ff78c09e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:30.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.837+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 shutdown_connections 2024-04-26T07:32:30.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.837+0000 7ff790c37700 1 -- 172.21.15.31:0/661896761 wait complete. 2024-04-26T07:32:30.848 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T07:32:30.848 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:32:30.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.954+0000 7fdd076f0700 1 Processor -- start 2024-04-26T07:32:30.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.954+0000 7fdd076f0700 1 -- start start 2024-04-26T07:32:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd076f0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd001360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd076f0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd00096320 0x7fdd0005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd076f0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0005be60 0x7fdd0005c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd076f0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd00133c10 con 0x7fdd00096320 2024-04-26T07:32:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd076f0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0005c800 con 0x7fdd0005be60 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd076f0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000970a0 con 0x7fdd0006c7d0 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd0548c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd001360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd05c8d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0005be60 0x7fdd0005c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd04c8b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd00096320 0x7fdd0005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd0548c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd001360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:48686/0 (socket says 172.21.15.31:48686) 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd0548c700 1 -- 172.21.15.31:0/3522761781 learned_addr learned my addr 172.21.15.31:0/3522761781 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd05c8d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0005be60 0x7fdd0005c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53742/0 (socket says 172.21.15.31:53742) 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd04c8b700 1 --2- 172.21.15.31:0/3522761781 >> v2:172.21.15.31:3300/0 conn(0x7fdd00096320 0x7fdd0005b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59252/0 (socket says 172.21.15.31:59252) 2024-04-26T07:32:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd05c8d700 1 -- 172.21.15.31:0/3522761781 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 msgr2=0x7fdd001360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd05c8d700 1 --2- 172.21.15.31:0/3522761781 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd001360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd05c8d700 1 -- 172.21.15.31:0/3522761781 >> v2:172.21.15.31:3300/0 conn(0x7fdd00096320 msgr2=0x7fdd0005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd05c8d700 1 --2- 172.21.15.31:0/3522761781 >> v2:172.21.15.31:3300/0 conn(0x7fdd00096320 0x7fdd0005b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd05c8d700 1 -- 172.21.15.31:0/3522761781 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00136780 con 0x7fdd0005be60 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd0548c700 1 --2- 172.21.15.31:0/3522761781 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd001360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.955+0000 7fdd05c8d700 1 --2- 172.21.15.31:0/3522761781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0005be60 0x7fdd0005c310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdcf80032f0 tx=0x7fdcf80091d0).ready entity=mon.1 client_cookie=808b51d673287941 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdceffff700 1 -- 172.21.15.31:0/3522761781 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcf800b600 con 0x7fdd0005be60 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdceffff700 1 -- 172.21.15.31:0/3522761781 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdcf800b760 con 0x7fdd0005be60 2024-04-26T07:32:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdceffff700 1 -- 172.21.15.31:0/3522761781 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcf800b8d0 con 0x7fdd0005be60 2024-04-26T07:32:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 -- 172.21.15.31:0/3522761781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0005be60 msgr2=0x7fdd0005c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 --2- 172.21.15.31:0/3522761781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0005be60 0x7fdd0005c310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdcf80032f0 tx=0x7fdcf80091d0).stop 2024-04-26T07:32:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 -- 172.21.15.31:0/3522761781 shutdown_connections 2024-04-26T07:32:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 --2- 172.21.15.31:0/3522761781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd0005be60 0x7fdd0005c310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 --2- 172.21.15.31:0/3522761781 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd001360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 --2- 172.21.15.31:0/3522761781 >> v2:172.21.15.31:3300/0 conn(0x7fdd00096320 0x7fdd0005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 -- 172.21.15.31:0/3522761781 >> 172.21.15.31:0/3522761781 conn(0x7fdd00061370 msgr2=0x7fdd0006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 -- 172.21.15.31:0/3522761781 shutdown_connections 2024-04-26T07:32:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.956+0000 7fdd076f0700 1 -- 172.21.15.31:0/3522761781 wait complete. 2024-04-26T07:32:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.957+0000 7fdd076f0700 1 Processor -- start 2024-04-26T07:32:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.957+0000 7fdd076f0700 1 -- start start 2024-04-26T07:32:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd076f0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0005be60 0x7fdd0009d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd076f0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd00146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd076f0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd00096320 0x7fdd00149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd076f0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd001462f0 con 0x7fdd0005be60 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd076f0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000665b0 con 0x7fdd00096320 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd076f0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0009ccc0 con 0x7fdd0006c7d0 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd0548c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0005be60 0x7fdd0009d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd05c8d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd00096320 0x7fdd00149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd0548c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0005be60 0x7fdd0009d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59258/0 (socket says 172.21.15.31:59258) 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd0548c700 1 -- 172.21.15.31:0/3718016243 learned_addr learned my addr 172.21.15.31:0/3718016243 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd04c8b700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd00146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd04c8b700 1 -- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd00096320 msgr2=0x7fdd00149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd04c8b700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd00096320 0x7fdd00149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd04c8b700 1 -- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0005be60 msgr2=0x7fdd0009d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd04c8b700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0005be60 0x7fdd0009d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd04c8b700 1 -- 172.21.15.31:0/3718016243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf000b1e0 con 0x7fdd0006c7d0 2024-04-26T07:32:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd0548c700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0005be60 0x7fdd0009d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd04c8b700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd00146710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdcfc00c000 tx=0x7fdcfc006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdcee7fc700 1 -- 172.21.15.31:0/3718016243 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcfc011750 con 0x7fdd0006c7d0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdcee7fc700 1 -- 172.21.15.31:0/3718016243 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdcfc0118b0 con 0x7fdd0006c7d0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf8009470 con 0x7fdd0006c7d0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.958+0000 7fdcee7fc700 1 -- 172.21.15.31:0/3718016243 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcfc011c10 con 0x7fdd0006c7d0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.959+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd000a6c30 con 0x7fdd0006c7d0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.959+0000 7fdcee7fc700 1 -- 172.21.15.31:0/3718016243 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdcfc011d70 con 0x7fdd0006c7d0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.959+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd00146430 con 0x7fdd0006c7d0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.960+0000 7fdcee7fc700 1 -- 172.21.15.31:0/3718016243 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdcfc04ab40 con 0x7fdd0006c7d0 2024-04-26T07:32:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:30.963+0000 7fdcee7fc700 1 -- 172.21.15.31:0/3718016243 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdd00146430 con 0x7fdd0006c7d0 2024-04-26T07:32:31.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.111+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd00146430 con 0x7fdd0006c7d0 2024-04-26T07:32:31.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.111+0000 7fdcee7fc700 1 -- 172.21.15.31:0/3718016243 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2310 (secure 0 0 0) 0x7fdd00146430 con 0x7fdd0006c7d0 2024-04-26T07:32:31.113 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:32:31.113 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4902,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6818/2715796505","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":2715796505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:29:17.982188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:32:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.112+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 >> v1:172.21.15.31:6816/39613 conn(0x7fdce0038dd0 legacy=0x7fdce003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.112+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 msgr2=0x7fdd00146710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.112+0000 7fdd076f0700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd00146710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdcfc00c000 tx=0x7fdcfc006df0).stop 2024-04-26T07:32:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.112+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 shutdown_connections 2024-04-26T07:32:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.112+0000 7fdd076f0700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd00096320 0x7fdd00149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.112+0000 7fdd076f0700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0005be60 0x7fdd0009d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.112+0000 7fdd076f0700 1 --2- 172.21.15.31:0/3718016243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdd0006c7d0 0x7fdd00146710 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.112+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 >> 172.21.15.31:0/3718016243 conn(0x7fdd00061370 msgr2=0x7fdd0006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.113+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 shutdown_connections 2024-04-26T07:32:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.113+0000 7fdd076f0700 1 -- 172.21.15.31:0/3718016243 wait complete. 2024-04-26T07:32:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 14 2024-04-26T07:32:31.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T07:32:31.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.232+0000 7fc6886b0700 1 Processor -- start 2024-04-26T07:32:31.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.232+0000 7fc6886b0700 1 -- start start 2024-04-26T07:32:31.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc6886b0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc680065870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc6886b0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6801374d0 0x7fc6800a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc6886b0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6800a9980 0x7fc68005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc6886b0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc680065420 con 0x7fc6800a9980 2024-04-26T07:32:31.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc6886b0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc680064f90 con 0x7fc6800a8380 2024-04-26T07:32:31.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc6886b0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc680137960 con 0x7fc6801374d0 2024-04-26T07:32:31.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc686c4d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6800a9980 0x7fc68005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc680065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc680065870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53748/0 (socket says 172.21.15.31:53748) 2024-04-26T07:32:31.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc686c4d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6800a9980 0x7fc68005b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59260/0 (socket says 172.21.15.31:59260) 2024-04-26T07:32:31.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 -- 172.21.15.31:0/3388026632 learned_addr learned my addr 172.21.15.31:0/3388026632 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:31.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc685c4b700 1 --2- 172.21.15.31:0/3388026632 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6801374d0 0x7fc6800a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 -- 172.21.15.31:0/3388026632 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6801374d0 msgr2=0x7fc6800a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:31.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 --2- 172.21.15.31:0/3388026632 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6801374d0 0x7fc6800a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 -- 172.21.15.31:0/3388026632 >> v2:172.21.15.31:3300/0 conn(0x7fc6800a9980 msgr2=0x7fc68005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:31.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 --2- 172.21.15.31:0/3388026632 >> v2:172.21.15.31:3300/0 conn(0x7fc6800a9980 0x7fc68005b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 -- 172.21.15.31:0/3388026632 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680137c20 con 0x7fc6800a8380 2024-04-26T07:32:31.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc686c4d700 1 --2- 172.21.15.31:0/3388026632 >> v2:172.21.15.31:3300/0 conn(0x7fc6800a9980 0x7fc68005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:31.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68644c700 1 --2- 172.21.15.31:0/3388026632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc680065870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fc67c002f70 tx=0x7fc67c006eb0).ready entity=mon.1 client_cookie=25a9339d78532df5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:31.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68544a700 1 -- 172.21.15.31:0/3388026632 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c00d570 con 0x7fc6800a8380 2024-04-26T07:32:31.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68544a700 1 -- 172.21.15.31:0/3388026632 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc67c000e90 con 0x7fc6800a8380 2024-04-26T07:32:31.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.233+0000 7fc68544a700 1 -- 172.21.15.31:0/3388026632 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c00d900 con 0x7fc6800a8380 2024-04-26T07:32:31.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 -- 172.21.15.31:0/3388026632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 msgr2=0x7fc680065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 --2- 172.21.15.31:0/3388026632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc680065870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fc67c002f70 tx=0x7fc67c006eb0).stop 2024-04-26T07:32:31.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 -- 172.21.15.31:0/3388026632 shutdown_connections 2024-04-26T07:32:31.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 --2- 172.21.15.31:0/3388026632 >> v2:172.21.15.31:3300/0 conn(0x7fc6800a9980 0x7fc68005b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 --2- 172.21.15.31:0/3388026632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc680065870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 --2- 172.21.15.31:0/3388026632 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6801374d0 0x7fc6800a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 -- 172.21.15.31:0/3388026632 >> 172.21.15.31:0/3388026632 conn(0x7fc680061370 msgr2=0x7fc68006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 -- 172.21.15.31:0/3388026632 shutdown_connections 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.234+0000 7fc6886b0700 1 -- 172.21.15.31:0/3388026632 wait complete. 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.235+0000 7fc6886b0700 1 Processor -- start 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.235+0000 7fc6886b0700 1 -- start start 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.235+0000 7fc6886b0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc6800935e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.235+0000 7fc6886b0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6800a9980 0x7fc680130dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.235+0000 7fc6886b0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc680095e10 0x7fc6801312c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.235+0000 7fc6886b0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801317b0 con 0x7fc680095e10 2024-04-26T07:32:31.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.235+0000 7fc6886b0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc680095930 con 0x7fc6800a8380 2024-04-26T07:32:31.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.235+0000 7fc6886b0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc680093b90 con 0x7fc6800a9980 2024-04-26T07:32:31.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc68644c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc6800935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc68644c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc6800935e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53756/0 (socket says 172.21.15.31:53756) 2024-04-26T07:32:31.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc686c4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc680095e10 0x7fc6801312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc68644c700 1 -- 172.21.15.31:0/740087994 learned_addr learned my addr 172.21.15.31:0/740087994 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc685c4b700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6800a9980 0x7fc680130dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc686c4d700 1 -- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6800a9980 msgr2=0x7fc680130dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc686c4d700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6800a9980 0x7fc680130dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc686c4d700 1 -- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 msgr2=0x7fc6800935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc686c4d700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc6800935e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc686c4d700 1 -- 172.21.15.31:0/740087994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67800d910 con 0x7fc680095e10 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc68644c700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc6800935e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:31.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc686c4d700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc680095e10 0x7fc6801312c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fc678010000 tx=0x7fc67800f040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:31.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc66f7fe700 1 -- 172.21.15.31:0/740087994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc678010b30 con 0x7fc680095e10 2024-04-26T07:32:31.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc66f7fe700 1 -- 172.21.15.31:0/740087994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc678013040 con 0x7fc680095e10 2024-04-26T07:32:31.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c00b1e0 con 0x7fc680095e10 2024-04-26T07:32:31.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc66f7fe700 1 -- 172.21.15.31:0/740087994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc678010e80 con 0x7fc680095e10 2024-04-26T07:32:31.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.236+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc680133050 con 0x7fc680095e10 2024-04-26T07:32:31.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.237+0000 7fc66f7fe700 1 -- 172.21.15.31:0/740087994 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc67801f030 con 0x7fc680095e10 2024-04-26T07:32:31.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.237+0000 7fc66f7fe700 1 -- 172.21.15.31:0/740087994 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc67804ebb0 con 0x7fc680095e10 2024-04-26T07:32:31.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.237+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc680095b30 con 0x7fc680095e10 2024-04-26T07:32:31.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.240+0000 7fc66f7fe700 1 -- 172.21.15.31:0/740087994 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc680095b30 con 0x7fc680095e10 2024-04-26T07:32:31.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.393+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc680095b30 con 0x7fc680095e10 2024-04-26T07:32:31.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.393+0000 7fc66f7fe700 1 -- 172.21.15.31:0/740087994 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2310 (secure 0 0 0) 0x7fc680095b30 con 0x7fc680095e10 2024-04-26T07:32:31.395 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:32:31.395 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3822161740","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3822161740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4902,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6818/2715796505","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":2715796505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T07:28:31.131715+0000","modified":"2024-04-26T07:29:17.982188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4207":{"gid":4207,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/4068193720","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":4068193720}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-26T07:32:31.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 >> v1:172.21.15.31:6816/39613 conn(0x7fc660038da0 legacy=0x7fc66003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc680095e10 msgr2=0x7fc6801312c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc680095e10 0x7fc6801312c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fc678010000 tx=0x7fc67800f040).stop 2024-04-26T07:32:31.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 shutdown_connections 2024-04-26T07:32:31.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc680095e10 0x7fc6801312c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6800a8380 0x7fc6800935e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 --2- 172.21.15.31:0/740087994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc6800a9980 0x7fc680130dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 >> 172.21.15.31:0/740087994 conn(0x7fc680061370 msgr2=0x7fc680067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:31.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 shutdown_connections 2024-04-26T07:32:31.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.395+0000 7fc6886b0700 1 -- 172.21.15.31:0/740087994 wait complete. 2024-04-26T07:32:31.398 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 14 2024-04-26T07:32:31.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:32:31.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.511+0000 7f1bca83a700 1 Processor -- start 2024-04-26T07:32:31.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.511+0000 7f1bca83a700 1 -- start start 2024-04-26T07:32:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bca83a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1bc40aca60 0x7f1bc40ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bca83a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc4139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bca83a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc405b970 con 0x7f1bc40a8af0 2024-04-26T07:32:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bca83a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc405c3d0 con 0x7f1bc40aca60 2024-04-26T07:32:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bca83a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc405d300 con 0x7f1bc405cbb0 2024-04-26T07:32:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1bc40aca60 0x7f1bc40ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc8dd7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc4139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1bc40a8af0 0x7f1bc4139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51444/0 (socket says 172.21.15.31:51444) 2024-04-26T07:32:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1bc40aca60 0x7f1bc40ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59274/0 (socket says 172.21.15.31:59274) 2024-04-26T07:32:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc8dd7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc4139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:48734/0 (socket says 172.21.15.31:48734) 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc37fe700 1 -- 172.21.15.31:0/3438402930 learned_addr learned my addr 172.21.15.31:0/3438402930 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc8dd7700 1 -- 172.21.15.31:0/3438402930 >> v2:172.21.15.31:3300/0 conn(0x7f1bc40aca60 msgr2=0x7f1bc40ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc8dd7700 1 --2- 172.21.15.31:0/3438402930 >> v2:172.21.15.31:3300/0 conn(0x7f1bc40aca60 0x7f1bc40ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc8dd7700 1 -- 172.21.15.31:0/3438402930 >> v1:172.21.15.31:6789/0 conn(0x7f1bc40a8af0 legacy=0x7f1bc4139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc8dd7700 1 -- 172.21.15.31:0/3438402930 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40ac400 con 0x7f1bc405cbb0 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc2ffd700 1 -- 172.21.15.31:0/3438402930 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144918175 0 0) 0x7f1bc405b970 con 0x7f1bc40a8af0 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.512+0000 7f1bc3fff700 1 --2- 172.21.15.31:0/3438402930 >> v2:172.21.15.31:3300/0 conn(0x7f1bc40aca60 0x7f1bc40ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bc8dd7700 1 --2- 172.21.15.31:0/3438402930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc4139c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f1bbc0032f0 tx=0x7f1bbc0091d0).ready entity=mon.2 client_cookie=3850fcb238b9202a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bc2ffd700 1 -- 172.21.15.31:0/3438402930 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bbc00b6c0 con 0x7f1bc405cbb0 2024-04-26T07:32:31.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bc2ffd700 1 -- 172.21.15.31:0/3438402930 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1bbc00b820 con 0x7f1bc405cbb0 2024-04-26T07:32:31.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bc2ffd700 1 -- 172.21.15.31:0/3438402930 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bbc00b990 con 0x7f1bc405cbb0 2024-04-26T07:32:31.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bca83a700 1 -- 172.21.15.31:0/3438402930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 msgr2=0x7f1bc4139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bca83a700 1 --2- 172.21.15.31:0/3438402930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc4139c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f1bbc0032f0 tx=0x7f1bbc0091d0).stop 2024-04-26T07:32:31.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bca83a700 1 -- 172.21.15.31:0/3438402930 shutdown_connections 2024-04-26T07:32:31.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bca83a700 1 --2- 172.21.15.31:0/3438402930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc4139c20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bca83a700 1 --2- 172.21.15.31:0/3438402930 >> v2:172.21.15.31:3300/0 conn(0x7f1bc40aca60 0x7f1bc40ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bca83a700 1 -- 172.21.15.31:0/3438402930 >> 172.21.15.31:0/3438402930 conn(0x7f1bc4066d50 msgr2=0x7f1bc4067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:31.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bca83a700 1 -- 172.21.15.31:0/3438402930 shutdown_connections 2024-04-26T07:32:31.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.513+0000 7f1bca83a700 1 -- 172.21.15.31:0/3438402930 wait complete. 2024-04-26T07:32:31.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.514+0000 7f1bca83a700 1 Processor -- start 2024-04-26T07:32:31.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.514+0000 7f1bca83a700 1 -- start start 2024-04-26T07:32:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bca83a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc411a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bca83a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1bc40a8af0 0x7f1bc4118ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bca83a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc40aca60 0x7f1bc4148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bca83a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4117940 con 0x7f1bc40aca60 2024-04-26T07:32:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bca83a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc41197f0 con 0x7f1bc40a8af0 2024-04-26T07:32:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bca83a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4119ed0 con 0x7f1bc405cbb0 2024-04-26T07:32:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc411a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc411a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:48748/0 (socket says 172.21.15.31:48748) 2024-04-26T07:32:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc3fff700 1 -- 172.21.15.31:0/532115610 learned_addr learned my addr 172.21.15.31:0/532115610 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:31.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc37fe700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1bc40a8af0 0x7f1bc4118ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc8dd7700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc40aca60 0x7f1bc4148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc3fff700 1 -- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1bc40a8af0 msgr2=0x7f1bc4118ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc3fff700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1bc40a8af0 0x7f1bc4118ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc3fff700 1 -- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc40aca60 msgr2=0x7f1bc4148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc3fff700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc40aca60 0x7f1bc4148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc3fff700 1 -- 172.21.15.31:0/532115610 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb400b180 con 0x7f1bc405cbb0 2024-04-26T07:32:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.515+0000 7f1bc37fe700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1bc40a8af0 0x7f1bc4118ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.516+0000 7f1bc3fff700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc411a6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1bb400c000 tx=0x7f1bb4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.516+0000 7f1bc17fa700 1 -- 172.21.15.31:0/532115610 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb400c6a0 con 0x7f1bc405cbb0 2024-04-26T07:32:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.516+0000 7f1bc17fa700 1 -- 172.21.15.31:0/532115610 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1bb400c800 con 0x7f1bc405cbb0 2024-04-26T07:32:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.516+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc009470 con 0x7f1bc405cbb0 2024-04-26T07:32:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.516+0000 7f1bc17fa700 1 -- 172.21.15.31:0/532115610 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb400cb60 con 0x7f1bc405cbb0 2024-04-26T07:32:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.516+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc41193b0 con 0x7f1bc405cbb0 2024-04-26T07:32:31.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.516+0000 7f1bc17fa700 1 -- 172.21.15.31:0/532115610 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1bb400ccc0 con 0x7f1bc405cbb0 2024-04-26T07:32:31.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.517+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc405d020 con 0x7f1bc405cbb0 2024-04-26T07:32:31.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.517+0000 7f1bc17fa700 1 -- 172.21.15.31:0/532115610 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1bb404aff0 con 0x7f1bc405cbb0 2024-04-26T07:32:31.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.520+0000 7f1bc17fa700 1 -- 172.21.15.31:0/532115610 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1bb4030390 con 0x7f1bc405cbb0 2024-04-26T07:32:31.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.637+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bc406bbc0 con 0x7f1bc405cbb0 2024-04-26T07:32:31.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.637+0000 7f1bc17fa700 1 -- 172.21.15.31:0/532115610 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7f1bb4033400 con 0x7f1bc405cbb0 2024-04-26T07:32:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-26T07:32:31.639 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"1efcad47-d196-4e33-a2f1-15c92eeb84f0","created":"2024-04-26T07:28:11.833739+0000","modified":"2024-04-26T07:28:45.886508+0000","last_up_change":"2024-04-26T07:28:16.980250+0000","last_in_change":"2024-04-26T07:28:16.980250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-26T07:28:14.020617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:28:20.865140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T07:28:28.939656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T07:28:30.129744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"996fe73f-646a-43ac-8ab7-64432ddb26f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40242}]},"public_addr":"172.21.15.31:6800/40242","cluster_addr":"172.21.15.31:6801/40242","heartbeat_back_addr":"172.21.15.31:6803/40242","heartbeat_front_addr":"172.21.15.31:6802/40242","state":["exists","up"]},{"osd":1,"uuid":"4733b11b-119d-4734-a403-5c68e528ee4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40241}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40241}]},"public_addr":"172.21.15.31:6808/40241","cluster_addr":"172.21.15.31:6809/40241","heartbeat_back_addr":"172.21.15.31:6811/40241","heartbeat_front_addr":"172.21.15.31:6810/40241","state":["exists","up"]},{"osd":2,"uuid":"dc9a2269-10b7-40d5-bbd8-fc7f52d98adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40244}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40244}]},"public_addr":"172.21.15.31:6812/40244","cluster_addr":"172.21.15.31:6813/40244","heartbeat_back_addr":"172.21.15.31:6815/40244","heartbeat_front_addr":"172.21.15.31:6814/40244","state":["exists","up"]},{"osd":3,"uuid":"a2b8d011-c9aa-4c78-8f70-feff7e8c8c10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40243}]},"public_addr":"172.21.15.31:6804/40243","cluster_addr":"172.21.15.31:6805/40243","heartbeat_back_addr":"172.21.15.31:6807/40243","heartbeat_front_addr":"172.21.15.31:6806/40243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.503067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.739563+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.820373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:28:15.830719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-26T07:32:31.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.638+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 >> v1:172.21.15.31:6816/39613 conn(0x7f1ba8038e30 legacy=0x7f1ba803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.638+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 msgr2=0x7f1bc411a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.638+0000 7f1bca83a700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc411a6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f1bb400c000 tx=0x7f1bb4006df0).stop 2024-04-26T07:32:31.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.639+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 shutdown_connections 2024-04-26T07:32:31.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.639+0000 7f1bca83a700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1bc405cbb0 0x7f1bc411a6b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.639+0000 7f1bca83a700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1bc40aca60 0x7f1bc4148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.639+0000 7f1bca83a700 1 --2- 172.21.15.31:0/532115610 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1bc40a8af0 0x7f1bc4118ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.639+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 >> 172.21.15.31:0/532115610 conn(0x7f1bc4066d50 msgr2=0x7f1bc406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.639+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 shutdown_connections 2024-04-26T07:32:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.639+0000 7f1bca83a700 1 -- 172.21.15.31:0/532115610 wait complete. 2024-04-26T07:32:31.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T07:32:31.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.756+0000 7fd63603e700 1 Processor -- start 2024-04-26T07:32:31.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.756+0000 7fd63603e700 1 -- start start 2024-04-26T07:32:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd63603e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6300648b0 0x7fd630136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd63603e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd630133340 0x7fd6301337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd63603e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63006cd70 con 0x7fd63006c990 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd63603e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd630137340 con 0x7fd630133340 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd63603e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd630132eb0 con 0x7fd6300648b0 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd62ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd630133340 0x7fd6301337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd62effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6300648b0 0x7fd630136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd62f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd63006c990 0x7fd630136c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51458/0 (socket says 172.21.15.31:51458) 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd62effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6300648b0 0x7fd630136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53768/0 (socket says 172.21.15.31:53768) 2024-04-26T07:32:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd62effd700 1 -- 172.21.15.31:0/1371314718 learned_addr learned my addr 172.21.15.31:0/1371314718 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.757+0000 7fd62ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd630133340 0x7fd6301337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59294/0 (socket says 172.21.15.31:59294) 2024-04-26T07:32:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62ffff700 1 -- 172.21.15.31:0/1371314718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6300648b0 msgr2=0x7fd630136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62ffff700 1 --2- 172.21.15.31:0/1371314718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6300648b0 0x7fd630136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62ffff700 1 -- 172.21.15.31:0/1371314718 >> v1:172.21.15.31:6789/0 conn(0x7fd63006c990 legacy=0x7fd630136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62ffff700 1 -- 172.21.15.31:0/1371314718 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd630063c00 con 0x7fd630133340 2024-04-26T07:32:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62e7fc700 1 -- 172.21.15.31:0/1371314718 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675698276 0 0) 0x7fd63006cd70 con 0x7fd63006c990 2024-04-26T07:32:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62ffff700 1 --2- 172.21.15.31:0/1371314718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd630133340 0x7fd6301337a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fd6280032f0 tx=0x7fd62800b470).ready entity=mon.0 client_cookie=7c614f933fdb42f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62e7fc700 1 -- 172.21.15.31:0/1371314718 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62800dd70 con 0x7fd630133340 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62e7fc700 1 -- 172.21.15.31:0/1371314718 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd628010470 con 0x7fd630133340 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd62e7fc700 1 -- 172.21.15.31:0/1371314718 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6280107d0 con 0x7fd630133340 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd63603e700 1 -- 172.21.15.31:0/1371314718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd630133340 msgr2=0x7fd6301337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd63603e700 1 --2- 172.21.15.31:0/1371314718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd630133340 0x7fd6301337a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fd6280032f0 tx=0x7fd62800b470).stop 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd63603e700 1 -- 172.21.15.31:0/1371314718 shutdown_connections 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd63603e700 1 --2- 172.21.15.31:0/1371314718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd630133340 0x7fd6301337a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd63603e700 1 --2- 172.21.15.31:0/1371314718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6300648b0 0x7fd630136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd63603e700 1 -- 172.21.15.31:0/1371314718 >> 172.21.15.31:0/1371314718 conn(0x7fd630061370 msgr2=0x7fd63006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.758+0000 7fd63603e700 1 -- 172.21.15.31:0/1371314718 shutdown_connections 2024-04-26T07:32:31.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.759+0000 7fd63603e700 1 -- 172.21.15.31:0/1371314718 wait complete. 2024-04-26T07:32:31.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.760+0000 7fd63603e700 1 Processor -- start 2024-04-26T07:32:31.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.760+0000 7fd63603e700 1 -- start start 2024-04-26T07:32:31.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.760+0000 7fd63603e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300648b0 0x7fd630095c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.760+0000 7fd63603e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd63006c990 0x7fd630091f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.760+0000 7fd63603e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd630133340 0x7fd630092400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:31.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.760+0000 7fd63603e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630093630 con 0x7fd6300648b0 2024-04-26T07:32:31.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.760+0000 7fd63603e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300938f0 con 0x7fd63006c990 2024-04-26T07:32:31.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.760+0000 7fd63603e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd630095100 con 0x7fd630133340 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300648b0 0x7fd630095c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300648b0 0x7fd630095c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59304/0 (socket says 172.21.15.31:59304) 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd63006c990 0x7fd630091f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 -- 172.21.15.31:0/2224672539 learned_addr learned my addr 172.21.15.31:0/2224672539 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62ffff700 1 --2- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd630133340 0x7fd630092400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 -- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd630133340 msgr2=0x7fd630092400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 --2- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd630133340 0x7fd630092400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 -- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd63006c990 msgr2=0x7fd630091f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:31.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 --2- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd63006c990 0x7fd630091f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:31.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 -- 172.21.15.31:0/2224672539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62800b710 con 0x7fd6300648b0 2024-04-26T07:32:31.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62f7fe700 1 --2- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300648b0 0x7fd630095c30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd620000bc0 tx=0x7fd620007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:31.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62cff9700 1 -- 172.21.15.31:0/2224672539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6200070d0 con 0x7fd6300648b0 2024-04-26T07:32:31.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62cff9700 1 -- 172.21.15.31:0/2224672539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd620007230 con 0x7fd6300648b0 2024-04-26T07:32:31.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd62cff9700 1 -- 172.21.15.31:0/2224672539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd620005740 con 0x7fd6300648b0 2024-04-26T07:32:31.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd630094b20 con 0x7fd6300648b0 2024-04-26T07:32:31.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.761+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd630130bc0 con 0x7fd6300648b0 2024-04-26T07:32:31.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.762+0000 7fd62cff9700 1 -- 172.21.15.31:0/2224672539 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd620010070 con 0x7fd6300648b0 2024-04-26T07:32:31.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.762+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd630095620 con 0x7fd6300648b0 2024-04-26T07:32:31.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.762+0000 7fd62cff9700 1 -- 172.21.15.31:0/2224672539 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd620049f60 con 0x7fd6300648b0 2024-04-26T07:32:31.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.765+0000 7fd62cff9700 1 -- 172.21.15.31:0/2224672539 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd630095620 con 0x7fd6300648b0 2024-04-26T07:32:31.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:31.915+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd630095620 con 0x7fd6300648b0 2024-04-26T07:32:32.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.842+0000 7fd62cff9700 1 -- 172.21.15.31:0/2224672539 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd630095620 con 0x7fd6300648b0 2024-04-26T07:32:32.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 >> v1:172.21.15.31:6816/39613 conn(0x7fd614038f50 legacy=0x7fd61403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:32.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300648b0 msgr2=0x7fd630095c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:32.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 --2- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300648b0 0x7fd630095c30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd620000bc0 tx=0x7fd620007a60).stop 2024-04-26T07:32:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 shutdown_connections 2024-04-26T07:32:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 --2- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd630133340 0x7fd630092400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 --2- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6300648b0 0x7fd630095c30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 --2- 172.21.15.31:0/2224672539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd63006c990 0x7fd630091f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 >> 172.21.15.31:0/2224672539 conn(0x7fd630061370 msgr2=0x7fd63005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 shutdown_connections 2024-04-26T07:32:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.845+0000 7fd63603e700 1 -- 172.21.15.31:0/2224672539 wait complete. 2024-04-26T07:32:32.848 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T07:32:32.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T07:32:32.875 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-04-26T07:32:32.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.977+0000 7f9d644b3700 1 Processor -- start 2024-04-26T07:32:32.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.977+0000 7f9d644b3700 1 -- start start 2024-04-26T07:32:32.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.977+0000 7f9d644b3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d5c139cf0 0x7f9d5c0aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:32.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.977+0000 7f9d644b3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c061060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.977+0000 7f9d644b3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c067990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.977+0000 7f9d644b3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c139830 con 0x7f9d5c139cf0 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.977+0000 7f9d644b3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c13a530 con 0x7f9d5c067500 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.977+0000 7f9d644b3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c139ad0 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c061060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d62a50700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d6224f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d5c139cf0 0x7f9d5c0aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c061060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:48764/0 (socket says 172.21.15.31:48764) 2024-04-26T07:32:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d62a50700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c067990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53788/0 (socket says 172.21.15.31:53788) 2024-04-26T07:32:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d6224f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d5c139cf0 0x7f9d5c0aaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59330/0 (socket says 172.21.15.31:59330) 2024-04-26T07:32:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 -- 172.21.15.31:0/2535907186 learned_addr learned my addr 172.21.15.31:0/2535907186 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 -- 172.21.15.31:0/2535907186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 msgr2=0x7f9d5c067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 --2- 172.21.15.31:0/2535907186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c067990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 -- 172.21.15.31:0/2535907186 >> v2:172.21.15.31:3300/0 conn(0x7f9d5c139cf0 msgr2=0x7f9d5c0aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 --2- 172.21.15.31:0/2535907186 >> v2:172.21.15.31:3300/0 conn(0x7f9d5c139cf0 0x7f9d5c0aaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 -- 172.21.15.31:0/2535907186 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c060760 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d62a50700 1 --2- 172.21.15.31:0/2535907186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d6224f700 1 --2- 172.21.15.31:0/2535907186 >> v2:172.21.15.31:3300/0 conn(0x7f9d5c139cf0 0x7f9d5c0aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d61a4e700 1 --2- 172.21.15.31:0/2535907186 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c061060 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9d4c002f70 tx=0x7f9d4c006eb0).ready entity=mon.2 client_cookie=8e1be95fdc7ff310 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d6124d700 1 -- 172.21.15.31:0/2535907186 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4c00d570 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d6124d700 1 -- 172.21.15.31:0/2535907186 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9d4c000e90 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.978+0000 7f9d6124d700 1 -- 172.21.15.31:0/2535907186 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4c00d900 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 -- 172.21.15.31:0/2535907186 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 msgr2=0x7f9d5c061060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 --2- 172.21.15.31:0/2535907186 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c061060 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9d4c002f70 tx=0x7f9d4c006eb0).stop 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 -- 172.21.15.31:0/2535907186 shutdown_connections 2024-04-26T07:32:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 --2- 172.21.15.31:0/2535907186 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 --2- 172.21.15.31:0/2535907186 >> v2:172.21.15.31:3300/0 conn(0x7f9d5c139cf0 0x7f9d5c0aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 --2- 172.21.15.31:0/2535907186 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c061060 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 -- 172.21.15.31:0/2535907186 >> 172.21.15.31:0/2535907186 conn(0x7f9d5c062460 msgr2=0x7f9d5c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 -- 172.21.15.31:0/2535907186 shutdown_connections 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.979+0000 7f9d644b3700 1 -- 172.21.15.31:0/2535907186 wait complete. 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d644b3700 1 Processor -- start 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d644b3700 1 -- start start 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d644b3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c097e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d644b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d5c139cf0 0x7f9d5c132d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:32.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d644b3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c133250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:32.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d644b3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c094d00 con 0x7f9d5c139cf0 2024-04-26T07:32:32.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d644b3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0993a0 con 0x7f9d5c067500 2024-04-26T07:32:32.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d644b3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c094f30 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d6224f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c097e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:32.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d62a50700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c133250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:32.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d6224f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c097e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53800/0 (socket says 172.21.15.31:53800) 2024-04-26T07:32:32.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.980+0000 7f9d6224f700 1 -- 172.21.15.31:0/1719271383 learned_addr learned my addr 172.21.15.31:0/1719271383 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:32.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d61a4e700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d5c139cf0 0x7f9d5c132d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:32.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d62a50700 1 -- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 msgr2=0x7f9d5c097e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:32.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d62a50700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c097e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d62a50700 1 -- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d5c139cf0 msgr2=0x7f9d5c132d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:32.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d62a50700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d5c139cf0 0x7f9d5c132d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:32.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d62a50700 1 -- 172.21.15.31:0/1719271383 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009470 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d61a4e700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d5c139cf0 0x7f9d5c132d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T07:32:32.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d6224f700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c097e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:32.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d62a50700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c133250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9d5c099a60 tx=0x7f9d540091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:32.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d4b7fe700 1 -- 172.21.15.31:0/1719271383 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d54009600 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d4b7fe700 1 -- 172.21.15.31:0/1719271383 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9d5400c850 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5800b180 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d4b7fe700 1 -- 172.21.15.31:0/1719271383 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5400cbb0 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.981+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c00b1e0 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.982+0000 7f9d4b7fe700 1 -- 172.21.15.31:0/1719271383 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9d54022070 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.982+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c061550 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.982+0000 7f9d4b7fe700 1 -- 172.21.15.31:0/1719271383 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3717+0+0 (secure 0 0 0) 0x7f9d5404afb0 con 0x7f9d5c13a0d0 2024-04-26T07:32:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:32.985+0000 7f9d4b7fe700 1 -- 172.21.15.31:0/1719271383 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9d54033830 con 0x7f9d5c13a0d0 2024-04-26T07:32:33.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.135+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9d5c097b40 con 0x7f9d5c13a0d0 2024-04-26T07:32:33.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.843+0000 7f9d4b7fe700 1 -- 172.21.15.31:0/1719271383 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9d54016070 con 0x7f9d5c13a0d0 2024-04-26T07:32:33.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.846+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 >> v1:172.21.15.31:6816/39613 conn(0x7f9d3c038da0 legacy=0x7f9d3c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:33.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.846+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 msgr2=0x7f9d5c133250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:33.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.846+0000 7f9d644b3700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c133250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9d5c099a60 tx=0x7f9d540091d0).stop 2024-04-26T07:32:33.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.846+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 shutdown_connections 2024-04-26T07:32:33.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.847+0000 7f9d644b3700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d5c13a0d0 0x7f9d5c133250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:33.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.847+0000 7f9d644b3700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d5c067500 0x7f9d5c097e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:33.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.847+0000 7f9d644b3700 1 --2- 172.21.15.31:0/1719271383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d5c139cf0 0x7f9d5c132d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:33.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.847+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 >> 172.21.15.31:0/1719271383 conn(0x7f9d5c062460 msgr2=0x7f9d5c1374e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:33.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.847+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 shutdown_connections 2024-04-26T07:32:33.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:33.847+0000 7f9d644b3700 1 -- 172.21.15.31:0/1719271383 wait complete. 2024-04-26T07:32:33.861 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T07:32:34.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.021+0000 7fb4b1eb0700 1 Processor -- start 2024-04-26T07:32:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.021+0000 7fb4b1eb0700 1 -- start start 2024-04-26T07:32:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4b1eb0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac096320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4b1eb0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4ac13e950 0x7fb4ac140d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4b1eb0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac097020 con 0x7fb4ac139d40 2024-04-26T07:32:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4b1eb0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac1395c0 con 0x7fb4ac13e950 2024-04-26T07:32:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4b1eb0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac139860 con 0x7fb4ac13a120 2024-04-26T07:32:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4abfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4ac13e950 0x7fb4ac140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4ab7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb4ac139d40 0x7fb4ac097740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51484/0 (socket says 172.21.15.31:51484) 2024-04-26T07:32:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4aaffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac096320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4ab7fe700 1 -- 172.21.15.31:0/2567886329 learned_addr learned my addr 172.21.15.31:0/2567886329 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:32:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4aaffd700 1 -- 172.21.15.31:0/2567886329 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac13e950 msgr2=0x7fb4ac140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:34.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4aaffd700 1 --2- 172.21.15.31:0/2567886329 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac13e950 0x7fb4ac140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4aaffd700 1 -- 172.21.15.31:0/2567886329 >> v1:172.21.15.31:6789/0 conn(0x7fb4ac139d40 legacy=0x7fb4ac097740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4aaffd700 1 -- 172.21.15.31:0/2567886329 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac139b20 con 0x7fb4ac13a120 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.022+0000 7fb4abfff700 1 --2- 172.21.15.31:0/2567886329 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac13e950 0x7fb4ac140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4aaffd700 1 --2- 172.21.15.31:0/2567886329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac096320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fb4a0002f70 tx=0x7fb4a0006df0).ready entity=mon.1 client_cookie=66c2997f48ce0d5c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4aa7fc700 1 -- 172.21.15.31:0/2567886329 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4a000d570 con 0x7fb4ac13a120 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4aa7fc700 1 -- 172.21.15.31:0/2567886329 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb4a0000e90 con 0x7fb4ac13a120 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4aa7fc700 1 -- 172.21.15.31:0/2567886329 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4a000d8c0 con 0x7fb4ac13a120 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/2567886329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 msgr2=0x7fb4ac096320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:34.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4b1eb0700 1 --2- 172.21.15.31:0/2567886329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac096320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fb4a0002f70 tx=0x7fb4a0006df0).stop 2024-04-26T07:32:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/2567886329 shutdown_connections 2024-04-26T07:32:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4b1eb0700 1 --2- 172.21.15.31:0/2567886329 >> v2:172.21.15.31:3300/0 conn(0x7fb4ac13e950 0x7fb4ac140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4b1eb0700 1 --2- 172.21.15.31:0/2567886329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac096320 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/2567886329 >> 172.21.15.31:0/2567886329 conn(0x7fb4ac0613e0 msgr2=0x7fb4ac06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/2567886329 shutdown_connections 2024-04-26T07:32:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.023+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/2567886329 wait complete. 2024-04-26T07:32:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.024+0000 7fb4b1eb0700 1 Processor -- start 2024-04-26T07:32:34.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.024+0000 7fb4b1eb0700 1 -- start start 2024-04-26T07:32:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4b1eb0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac139d40 0x7fb4ac146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4b1eb0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4b1eb0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb4ac13e950 0x7fb4ac149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4b1eb0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0642f0 con 0x7fb4ac139d40 2024-04-26T07:32:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4b1eb0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac063fa0 con 0x7fb4ac13a120 2024-04-26T07:32:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4b1eb0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0647e0 con 0x7fb4ac13e950 2024-04-26T07:32:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4aaffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4aaffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53828/0 (socket says 172.21.15.31:53828) 2024-04-26T07:32:34.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4aaffd700 1 -- 172.21.15.31:0/3591897372 learned_addr learned my addr 172.21.15.31:0/3591897372 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:34.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4ab7fe700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac139d40 0x7fb4ac146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:34.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4abfff700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb4ac13e950 0x7fb4ac149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:34.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4aaffd700 1 -- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb4ac13e950 msgr2=0x7fb4ac149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:34.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4aaffd700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb4ac13e950 0x7fb4ac149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:34.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4aaffd700 1 -- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac139d40 msgr2=0x7fb4ac146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:34.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4aaffd700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac139d40 0x7fb4ac146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:34.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4aaffd700 1 -- 172.21.15.31:0/3591897372 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4009470 con 0x7fb4ac13a120 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.025+0000 7fb4ab7fe700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac139d40 0x7fb4ac146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.026+0000 7fb4aaffd700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac146930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb4a0002f70 tx=0x7fb4a0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.026+0000 7fb4a8ff9700 1 -- 172.21.15.31:0/3591897372 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4a00138d0 con 0x7fb4ac13a120 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.026+0000 7fb4a8ff9700 1 -- 172.21.15.31:0/3591897372 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb4a0013a30 con 0x7fb4ac13a120 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.026+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a000b180 con 0x7fb4ac13a120 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.026+0000 7fb4a8ff9700 1 -- 172.21.15.31:0/3591897372 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4a0013d90 con 0x7fb4ac13a120 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.026+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac062680 con 0x7fb4ac13a120 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.027+0000 7fb4a8ff9700 1 -- 172.21.15.31:0/3591897372 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb4a001c070 con 0x7fb4ac13a120 2024-04-26T07:32:34.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.027+0000 7fb4a8ff9700 1 -- 172.21.15.31:0/3591897372 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3717+0+0 (secure 0 0 0) 0x7fb4a004b420 con 0x7fb4ac13a120 2024-04-26T07:32:34.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.027+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac0a9f40 con 0x7fb4ac13a120 2024-04-26T07:32:34.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.030+0000 7fb4a8ff9700 1 -- 172.21.15.31:0/3591897372 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb4a002e020 con 0x7fb4ac13a120 2024-04-26T07:32:34.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.148+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb4ac133980 con 0x7fb4ac13a120 2024-04-26T07:32:34.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.854+0000 7fb4a8ff9700 1 -- 172.21.15.31:0/3591897372 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v21) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb4a0021c20 con 0x7fb4ac13a120 2024-04-26T07:32:34.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.861+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 >> v1:172.21.15.31:6816/39613 conn(0x7fb48c038da0 legacy=0x7fb48c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:34.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.861+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 msgr2=0x7fb4ac146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:34.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.861+0000 7fb4b1eb0700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac146930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb4a0002f70 tx=0x7fb4a0006df0).stop 2024-04-26T07:32:34.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.861+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 shutdown_connections 2024-04-26T07:32:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.861+0000 7fb4b1eb0700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb4ac13e950 0x7fb4ac149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.861+0000 7fb4b1eb0700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4ac139d40 0x7fb4ac146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.861+0000 7fb4b1eb0700 1 --2- 172.21.15.31:0/3591897372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4ac13a120 0x7fb4ac146930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.861+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 >> 172.21.15.31:0/3591897372 conn(0x7fb4ac0613e0 msgr2=0x7fb4ac0981d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.862+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 shutdown_connections 2024-04-26T07:32:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.862+0000 7fb4b1eb0700 1 -- 172.21.15.31:0/3591897372 wait complete. 2024-04-26T07:32:34.870 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-04-26T07:32:34.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T07:32:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.994+0000 7fa5d68ac700 1 Processor -- start 2024-04-26T07:32:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.994+0000 7fa5d68ac700 1 -- start start 2024-04-26T07:32:34.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d68ac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0065650 0x7fa5d0134a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:34.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d68ac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5d0137400 0x7fa5d013e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:34.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d68ac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00649f0 con 0x7fa5d0134620 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d68ac700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d0134180 con 0x7fa5d0137400 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d68ac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0134420 con 0x7fa5d0065650 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d4e49700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5d0137400 0x7fa5d013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5cf7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0065650 0x7fa5d0134a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5cffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa5d0134620 0x7fa5d0137d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51500/0 (socket says 172.21.15.31:51500) 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d4e49700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5d0137400 0x7fa5d013e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59368/0 (socket says 172.21.15.31:59368) 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5cffff700 1 -- 172.21.15.31:0/3501591374 learned_addr learned my addr 172.21.15.31:0/3501591374 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d4e49700 1 -- 172.21.15.31:0/3501591374 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0065650 msgr2=0x7fa5d0134a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T07:32:34.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d4e49700 1 --2- 172.21.15.31:0/3501591374 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0065650 0x7fa5d0134a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:35.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d4e49700 1 -- 172.21.15.31:0/3501591374 >> v1:172.21.15.31:6789/0 conn(0x7fa5d0134620 legacy=0x7fa5d0137d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:35.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5ceffd700 1 -- 172.21.15.31:0/3501591374 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730751738 0 0) 0x7fa5d00649f0 con 0x7fa5d0134620 2024-04-26T07:32:35.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d4e49700 1 -- 172.21.15.31:0/3501591374 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0133eb0 con 0x7fa5d0137400 2024-04-26T07:32:35.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5d4e49700 1 --2- 172.21.15.31:0/3501591374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 0x7fa5d013e760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fa5c80032f0 tx=0x7fa5c80091d0).ready entity=mon.0 client_cookie=33367beeaf2b9645 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:35.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.995+0000 7fa5ceffd700 1 -- 172.21.15.31:0/3501591374 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5c800b6c0 con 0x7fa5d0137400 2024-04-26T07:32:35.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5ceffd700 1 -- 172.21.15.31:0/3501591374 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa5c800b820 con 0x7fa5d0137400 2024-04-26T07:32:35.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5ceffd700 1 -- 172.21.15.31:0/3501591374 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5c800b990 con 0x7fa5d0137400 2024-04-26T07:32:35.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5d68ac700 1 -- 172.21.15.31:0/3501591374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 msgr2=0x7fa5d013e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5d68ac700 1 --2- 172.21.15.31:0/3501591374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 0x7fa5d013e760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fa5c80032f0 tx=0x7fa5c80091d0).stop 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5d68ac700 1 -- 172.21.15.31:0/3501591374 shutdown_connections 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5d68ac700 1 --2- 172.21.15.31:0/3501591374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 0x7fa5d013e760 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5d68ac700 1 --2- 172.21.15.31:0/3501591374 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0065650 0x7fa5d0134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5d68ac700 1 -- 172.21.15.31:0/3501591374 >> 172.21.15.31:0/3501591374 conn(0x7fa5d005d060 msgr2=0x7fa5d00624d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5d68ac700 1 -- 172.21.15.31:0/3501591374 shutdown_connections 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.996+0000 7fa5d68ac700 1 -- 172.21.15.31:0/3501591374 wait complete. 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.997+0000 7fa5d68ac700 1 Processor -- start 2024-04-26T07:32:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.997+0000 7fa5d68ac700 1 -- start start 2024-04-26T07:32:35.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d68ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d0065650 0x7fa5d0098190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:35.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d68ac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0134620 0x7fa5d0098ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:35.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d68ac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 0x7fa5d0149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-26T07:32:35.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d68ac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0061380 con 0x7fa5d0137400 2024-04-26T07:32:35.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d68ac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0149090 con 0x7fa5d0065650 2024-04-26T07:32:35.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d68ac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0099f90 con 0x7fa5d0134620 2024-04-26T07:32:35.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5cffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d0065650 0x7fa5d0098190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d4e49700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 0x7fa5d0149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5cffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d0065650 0x7fa5d0098190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53836/0 (socket says 172.21.15.31:53836) 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5cffff700 1 -- 172.21.15.31:0/75077222 learned_addr learned my addr 172.21.15.31:0/75077222 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5cf7fe700 1 --2- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0134620 0x7fa5d0098ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d4e49700 1 -- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0134620 msgr2=0x7fa5d0098ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d4e49700 1 --2- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0134620 0x7fa5d0098ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d4e49700 1 -- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d0065650 msgr2=0x7fa5d0098190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d4e49700 1 --2- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d0065650 0x7fa5d0098190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:35.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d4e49700 1 -- 172.21.15.31:0/75077222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c8009470 con 0x7fa5d0137400 2024-04-26T07:32:35.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d4e49700 1 --2- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 0x7fa5d0149310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa5c80032f0 tx=0x7fa5c80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T07:32:35.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5cd7fa700 1 -- 172.21.15.31:0/75077222 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5c8006ea0 con 0x7fa5d0137400 2024-04-26T07:32:35.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5cd7fa700 1 -- 172.21.15.31:0/75077222 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa5c8011b80 con 0x7fa5d0137400 2024-04-26T07:32:35.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d0097610 con 0x7fa5d0137400 2024-04-26T07:32:35.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.998+0000 7fa5cd7fa700 1 -- 172.21.15.31:0/75077222 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5c800b6c0 con 0x7fa5d0137400 2024-04-26T07:32:35.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.999+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d0061680 con 0x7fa5d0137400 2024-04-26T07:32:35.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.999+0000 7fa5cd7fa700 1 -- 172.21.15.31:0/75077222 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa5c8024030 con 0x7fa5d0137400 2024-04-26T07:32:35.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:34.999+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d006bbc0 con 0x7fa5d0137400 2024-04-26T07:32:35.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.000+0000 7fa5cd7fa700 1 -- 172.21.15.31:0/75077222 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3279+0+0 (secure 0 0 0) 0x7fa5c804b7f0 con 0x7fa5d0137400 2024-04-26T07:32:35.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.003+0000 7fa5cd7fa700 1 -- 172.21.15.31:0/75077222 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa5c80285d0 con 0x7fa5d0137400 2024-04-26T07:32:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.119+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa5d0068260 con 0x7fa5d0137400 2024-04-26T07:32:35.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.851+0000 7fa5cd7fa700 1 -- 172.21.15.31:0/75077222 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v22) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa5c8028400 con 0x7fa5d0137400 2024-04-26T07:32:35.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 >> v1:172.21.15.31:6816/39613 conn(0x7fa5b4038da0 legacy=0x7fa5b403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:35.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 msgr2=0x7fa5d0149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T07:32:35.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 --2- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 0x7fa5d0149310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa5c80032f0 tx=0x7fa5c80091d0).stop 2024-04-26T07:32:35.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 shutdown_connections 2024-04-26T07:32:35.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 --2- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5d0137400 0x7fa5d0149310 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:35.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 --2- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5d0065650 0x7fa5d0098190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:35.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 --2- 172.21.15.31:0/75077222 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5d0134620 0x7fa5d0098ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-26T07:32:35.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 >> 172.21.15.31:0/75077222 conn(0x7fa5d005d060 msgr2=0x7fa5d0063880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T07:32:35.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 shutdown_connections 2024-04-26T07:32:35.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-26T07:32:35.854+0000 7fa5d68ac700 1 -- 172.21.15.31:0/75077222 wait complete. 2024-04-26T07:32:35.858 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-04-26T07:32:35.877 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T07:32:35.877 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T07:32:35.877 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:35.889 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T07:32:35.890 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T07:32:35.890 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:35.939 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T07:32:35.939 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T07:32:35.939 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:35.988 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T07:32:35.988 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T07:32:35.988 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T07:32:35.989 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.056 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T07:32:36.056 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T07:32:36.056 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.121 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T07:32:36.121 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T07:32:36.121 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.193 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T07:32:36.193 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T07:32:36.194 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.260 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T07:32:36.260 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T07:32:36.260 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T07:32:36.261 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.319 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T07:32:36.319 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T07:32:36.319 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.379 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T07:32:36.379 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T07:32:36.379 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T07:32:36.379 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.431 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T07:32:36.431 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T07:32:36.431 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.483 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T07:32:36.483 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T07:32:36.483 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:32:36.536 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T07:32:36.537 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T07:32:36.537 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'missing required features' | head -n 1 2024-04-26T07:32:36.623 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:32:36.623 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T07:32:36.903 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:32:36.904 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T07:32:37.011 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:32:37.011 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T07:32:37.086 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:32:37.087 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T07:32:37.159 INFO:tasks.ceph:Archiving mon data... 2024-04-26T07:32:37.161 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/data/mon.a.tgz 2024-04-26T07:32:37.161 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-26T07:32:37.181 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.FLuFxqMEh1 2024-04-26T07:32:37.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FLuFxqMEh1 2024-04-26T07:32:37.490 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.FLuFxqMEh1 2024-04-26T07:32:37.578 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.FLuFxqMEh1 is 594KB 2024-04-26T07:32:37.678 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.FLuFxqMEh1 2024-04-26T07:32:37.696 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/data/mon.b.tgz 2024-04-26T07:32:37.696 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-26T07:32:37.753 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.Xe37QUEka6 2024-04-26T07:32:37.754 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Xe37QUEka6 2024-04-26T07:32:37.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.Xe37QUEka6 2024-04-26T07:32:38.085 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.Xe37QUEka6 is 794KB 2024-04-26T07:32:38.188 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.Xe37QUEka6 2024-04-26T07:32:38.206 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/data/mon.c.tgz 2024-04-26T07:32:38.206 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-26T07:32:38.262 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.rABZX0QX0e 2024-04-26T07:32:38.263 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.rABZX0QX0e 2024-04-26T07:32:38.507 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.rABZX0QX0e 2024-04-26T07:32:38.595 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.rABZX0QX0e is 794KB 2024-04-26T07:32:38.695 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.rABZX0QX0e 2024-04-26T07:32:38.713 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T07:32:38.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T07:32:38.755 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T07:32:38.758 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T07:32:38.794 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T07:32:38.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T07:32:38.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T07:32:38.833 DEBUG:teuthology.orchestra.run.smithi172:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T07:32:38.848 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T07:32:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T07:32:38.866 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T07:32:38.873 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T07:32:38.875 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi031/crash 2024-04-26T07:32:38.876 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T07:32:38.921 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi057/crash 2024-04-26T07:32:38.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T07:32:38.959 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi172/crash 2024-04-26T07:32:38.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T07:32:39.004 INFO:tasks.ceph:Compressing logs... 2024-04-26T07:32:39.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:32:39.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:32:39.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:32:40.168 INFO:tasks.ceph:Archiving logs... 2024-04-26T07:32:40.168 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi031/log 2024-04-26T07:32:40.169 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T07:32:40.459 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi057/log 2024-04-26T07:32:40.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T07:32:40.494 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi172/log 2024-04-26T07:32:40.495 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T07:32:40.529 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T07:32:40.552 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T07:32:40.552 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T07:32:40.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T07:32:40.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T07:32:40.725 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T07:32:40.735 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T07:32:40.736 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:32:40.738 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:32:40.742 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:32:40.754 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2024-04-26T07:32:40.758 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:32:40.758 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-04-26T07:32:40.758 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +257us[ +265us] +/- 54ms 2024-04-26T07:32:40.758 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -1281us[-1281us] +/- 74ms 2024-04-26T07:32:40.758 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +1012us[+1020us] +/- 79ms 2024-04-26T07:32:40.759 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:32:40.760 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2024-04-26T07:32:40.763 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2024-04-26T07:32:40.765 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:32:40.766 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-04-26T07:32:40.766 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +245us[ +271us] +/- 54ms 2024-04-26T07:32:40.766 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -1262us[-1236us] +/- 74ms 2024-04-26T07:32:40.766 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +1025us[+1051us] +/- 79ms 2024-04-26T07:32:40.766 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:32:40.768 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T07:32:40.768 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-26T07:32:40.768 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +255us[ +268us] +/- 54ms 2024-04-26T07:32:40.768 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -1265us[-1251us] +/- 74ms 2024-04-26T07:32:40.768 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +1032us[+1045us] +/- 79ms 2024-04-26T07:32:40.768 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T07:32:40.769 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T07:32:40.779 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T07:32:40.780 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T07:32:40.801 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T07:32:40.871 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T07:32:40.938 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T07:32:41.007 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T07:32:41.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:32:41.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T07:32:41.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:32:41.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T07:32:41.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:32:41.104 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T07:32:41.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T07:32:41.200 INFO:teuthology.task.internal:Duration was 804.539807 seconds 2024-04-26T07:32:41.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T07:32:41.245 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T07:32:41.246 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T07:32:41.248 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T07:32:41.250 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T07:32:41.296 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:32:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:32:41.301 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T07:32:41.645 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T07:32:41.645 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-04-26T07:32:41.646 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T07:32:41.672 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-04-26T07:32:41.672 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T07:32:41.701 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-04-26T07:32:41.701 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T07:32:41.725 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T07:32:41.726 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:32:41.728 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:32:41.743 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:32:41.809 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T07:32:41.810 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T07:32:41.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T07:32:41.814 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T07:32:41.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T07:32:41.930 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T07:32:41.930 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T07:32:41.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T07:32:41.987 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T07:32:42.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T07:32:42.026 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:32:42.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:32:42.030 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-04-26T07:32:42.055 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-04-26T07:32:42.081 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-04-26T07:32:42.095 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:32:42.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:32:42.137 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:32:42.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:32:42.155 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:32:42.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:32:42.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T07:32:42.183 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T07:32:42.184 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi031 2024-04-26T07:32:42.184 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T07:32:42.223 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi057 2024-04-26T07:32:42.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T07:32:42.263 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_22:24:15-fs-reef-distro-default-smithi/7672592/remote/smithi172 2024-04-26T07:32:42.263 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T07:32:42.300 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T07:32:42.300 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T07:32:42.303 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T07:32:42.305 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T07:32:42.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T07:32:42.366 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T07:32:42.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T07:32:42.385 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T07:32:42.386 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T07:32:42.388 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T07:32:42.390 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T07:32:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 07:32 /home/ubuntu/cephtest 2024-04-26T07:32:42.406 INFO:teuthology.orchestra.run.smithi057.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 07:32 /home/ubuntu/cephtest 2024-04-26T07:32:42.409 INFO:teuthology.orchestra.run.smithi172.stdout: 393225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 07:32 /home/ubuntu/cephtest 2024-04-26T07:32:42.411 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T07:32:42.422 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T07:32:42.488 INFO:teuthology.run:Summary data: description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} duration: 804.5398070812225 failure_reason: ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8. flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=af5dd03b2d34485aae381892b6711fae status: fail success: false 2024-04-26T07:32:42.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T07:32:42.591 INFO:teuthology.run:FAIL